![[Jenkins]](/jenkins/static/b68c8964/images/svgs/logo.svg){kind=logo}
Started by upstream project "osmo-gsm-tester_build-osmo-ggsn" build number 6693 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6688 originally caused by: Started by upstream project "master-libosmocore" build number 3072 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8717 originally caused by: Started by upstream project "master-osmo-hlr" build number 8852 originally caused by: Started by upstream project "master-libosmo-netif" build number 6969 originally caused by: Started by upstream project "master-libosmo-abis" build number 4962 originally caused by: Started by upstream project "master-libosmocore" build number 3072 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8962 originally caused by: Started by upstream project "master-osmo-mgw" build number 9194 originally caused by: Started by upstream project "master-libosmo-netif" build number 6969 originally caused by: Started by upstream project "master-libosmo-abis" build number 4962 originally caused by: Started by upstream project "master-libosmocore" build number 3072 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9258 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9129 originally caused by: Started by upstream project "master-libosmo-netif" build number 6969 originally caused by: Started by upstream project "master-libosmo-abis" build number 4962 originally caused by: Started by upstream project "master-libosmocore" build number 3072 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30096 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37267 originally caused by: Started by upstream project "master-libosmo-netif" build number 6969 originally caused by: Started by upstream project "master-libosmo-abis" build number 4962 originally caused by: Started by upstream project "master-libosmocore" build number 3072 originally caused by: Started by an SCM change Started by upstream project "master-osmo-sgsn" build number 37266 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6688 originally caused by: Started by upstream project "master-libosmocore" build number 3072 Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17683 originally caused by: Started by upstream project "master-osmo-bsc" build number 20145 originally caused by: Started by upstream project "master-osmo-mgw" build number 9194 originally caused by: Started by upstream project "master-libosmo-netif" build number 6969 originally caused by: Started by upstream project "master-libosmo-abis" build number 4962 originally caused by: Started by upstream project "master-libosmocore" build number 3072 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-bts" build number 7512 originally caused by: Started by upstream project "master-osmo-bts" build number 7576 originally caused by: Started by upstream project "master-libosmo-abis" build number 4962 originally caused by: Started by upstream project "master-libosmocore" build number 3072 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5539 originally caused by: Started by upstream project "master-osmo-bts" build number 7576 originally caused by: Started by upstream project "master-libosmo-abis" build number 4962 originally caused by: Started by upstream project "master-libosmocore" build number 3072 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8043 originally caused by: Started by upstream project "master-osmo-bts" build number 7576 originally caused by: Started by upstream project "master-libosmo-abis" build number 4962 originally caused by: Started by upstream project "master-libosmocore" build number 3072 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29310 originally caused by: Started by upstream project "master-osmo-msc" build number 34272 originally caused by: Started by upstream project "master-osmo-mgw" build number 9194 originally caused by: Started by upstream project "master-libosmo-netif" build number 6969 originally caused by: Started by upstream project "master-libosmo-abis" build number 4962 originally caused by: Started by upstream project "master-libosmocore" build number 3072 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17684 originally caused by: Started by upstream project "master-osmo-bsc" build number 20146 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9129 originally caused by: Started by upstream project "master-libosmo-netif" build number 6969 originally caused by: Started by upstream project "master-libosmo-abis" build number 4962 originally caused by: Started by upstream project "master-libosmocore" build number 3072 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30097 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37268 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9129 originally caused by: Started by upstream project "master-libosmo-netif" build number 6969 originally caused by: Started by upstream project "master-libosmo-abis" build number 4962 originally caused by: Started by upstream project "master-libosmocore" build number 3072 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12993 originally caused by: Started by upstream project "master-openbsc" build number 13190 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9129 originally caused by: Started by upstream project "master-libosmo-netif" build number 6969 originally caused by: Started by upstream project "master-libosmo-abis" build number 4962 originally caused by: Started by upstream project "master-libosmocore" build number 3072 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-trx" build number 4685 originally caused by: Started by upstream project "master-osmo-trx" build number 4894 originally caused by: Started by upstream project "master-libosmocore" build number 3072 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29311 originally caused by: Started by upstream project "master-osmo-msc" build number 34273 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9129 originally caused by: Started by upstream project "master-libosmo-netif" build number 6969 originally caused by: Started by upstream project "master-libosmo-abis" build number 4962 originally caused by: Started by upstream project "master-libosmocore" build number 3072 originally caused by: Started by an SCM change Started by upstream project "master-osmo-msc" build number 34274 originally caused by: Started by upstream project "master-osmo-iuh" build number 12876 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9129 Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30098 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37269 originally caused by: Started by upstream project "master-osmo-iuh" build number 12876 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9129 originally caused by: Started by upstream project "master-libosmo-netif" build number 6969 originally caused by: Started by upstream project "master-libosmo-abis" build number 4962 originally caused by: Started by upstream project "master-libosmocore" build number 3072 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29312 originally caused by: Started by upstream project "master-osmo-msc" build number 34275 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts" build number 7513 originally caused by: Started by upstream project "master-osmo-bts" build number 7577 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5540 originally caused by: Started by upstream project "master-osmo-bts" build number 7577 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8044 originally caused by: Started by upstream project "master-osmo-bts" build number 7577 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17684 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7513 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6693 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8717 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8962 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2991 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29312 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5155 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30098 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4685 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12993 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9258 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4713 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8044 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5194 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5540 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3911 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins18299014832332970252.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-14 00:40:11 + trial_dir_prefix=trial- + rm -rf trial-2396 trial-2396-bin.tgz trial-2396-run.tgz + trial_dir=trial-2397 + mkdir -p trial-2397 + mv open5gs.build-8.tgz osmo-bsc.build-17684.tgz osmo-bts-oc2g.build-5540.tgz osmo-bts-sysmo.build-8044.tgz osmo-bts.build-7513.tgz osmo-ggsn.build-6693.tgz osmo-hlr.build-8717.tgz osmo-hnbgw.build-2991.tgz osmo-mgw.build-8962.tgz osmo-msc.build-29312.tgz osmo-nitb.build-12993.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30098.tgz osmo-stp.build-9258.tgz osmo-trx.build-4685.tgz osmocom-bb.build-4713.tgz srslte.build-19.tgz trial-2397 + cat open5gs.build-8.md5 osmo-bsc.build-17684.md5 osmo-bts-oc2g.build-5540.md5 osmo-bts-sysmo.build-8044.md5 osmo-bts.build-7513.md5 osmo-ggsn.build-6693.md5 osmo-hlr.build-8717.md5 osmo-hnbgw.build-2991.md5 osmo-mgw.build-8962.md5 osmo-msc.build-29312.md5 osmo-nitb.build-12993.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30098.md5 osmo-stp.build-9258.md5 osmo-trx.build-4685.md5 osmocom-bb.build-4713.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17684.md5 osmo-bts-oc2g.build-5540.md5 osmo-bts-sysmo.build-8044.md5 osmo-bts.build-7513.md5 osmo-ggsn.build-6693.md5 osmo-hlr.build-8717.md5 osmo-hnbgw.build-2991.md5 osmo-mgw.build-8962.md5 osmo-msc.build-29312.md5 osmo-nitb.build-12993.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30098.md5 osmo-stp.build-9258.md5 osmo-trx.build-4685.md5 osmocom-bb.build-4713.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2397 combinations: None trial: 'trial-2397' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2397 -------------------------------------------------------------------------------------------- 00:40:22.293013 tst trial-2397: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/log --------------------------------------------------------------------- trial-2397 nitb_sms:sysmo --------------------------------------------------------------------- 00:42:28.454629 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:42:28.458223 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 00:42:28.478728 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 00:42:28.485400 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 00:42:28.537801 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 00:42:28.559573 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 00:42:28.567026 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 00:42:29.102727 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 00:42:29.107810 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 00:42:29.118713 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 00:42:29.491956 tst mo_mt_sms.py: using LAC 37352 00:42:29.727716 tst mo_mt_sms.py: using RAC 122 00:42:29.843459 tst mo_mt_sms.py: using CellId 37352 00:42:29.957028 tst mo_mt_sms.py: using BVCI 37353 00:42:30.061751 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 00:42:30.238758 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 00:42:30.351995 tst mo_mt_sms.py:9: start nitb and bts... 00:42:30.548643 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:42:32.958445 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20057): Launched 00:42:33.281637 run osmo-nitb_10.42.42.2(pid=20058): Launched 00:42:33.446289 run osmo-nitb_10.42.42.2(pid=20058): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20058)] 00:42:33.569502 run osmo-nitb_10.42.42.2(pid=20058): stdout: | (launched: 2022-12-14_00:42:33.220763) 00:42:33.694173 run osmo-nitb_10.42.42.2(pid=20058): stderr: | (launched: 2022-12-14_00:42:33.268241) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:42:33.818645 run osmo-nitb_10.42.42.2(pid=20058): stdout: | (launched: 2022-12-14_00:42:33.220763) 00:42:33.938717 run osmo-nitb_10.42.42.2(pid=20058): stderr: | (launched: 2022-12-14_00:42:33.268241) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:42:34.082074 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=20058): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20058) [trial-2397↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20058)] [trial-2397↪nitb_sms:sysmo↪mo_mt_sms.py:11] 00:42:34.090496 tst mo_mt_sms.py:11: Test FAILED (5.0 sec) 00:42:34.096940 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20057): Terminating (SIGTERM) 00:42:34.305145 --- ParallelTerminationStrategy: PID 20057 died... 00:42:34.325219 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20057): Terminated: ok {rc=0} 00:42:34.408168 bus /sierra_3: Setting Powered False 00:42:35.506673 bus /sierra_3: Setting Powered False 00:42:36.626715 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 sms:sysmo --------------------------------------------------------------------- 00:42:37.809586 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:42:37.813475 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 00:42:37.834027 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 00:42:37.860615 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 00:42:37.912768 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 00:42:37.934506 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 00:42:37.962509 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 00:42:38.513891 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 sms:sysmo mo_mt_sms.py ---------------------------------------------- 00:42:38.520392 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 00:42:38.532257 tst sms:sysmo: Using 1 x bts (candidates: 1) 00:42:38.566455 tst mo_mt_sms.py: using LAC 37353 00:42:38.691429 tst mo_mt_sms.py: using RAC 123 00:42:38.816044 tst mo_mt_sms.py: using CellId 37353 00:42:38.941796 tst mo_mt_sms.py: using BVCI 37354 00:42:39.059633 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 00:42:39.070746 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 00:42:39.081682 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 00:42:39.092368 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 00:42:39.103677 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 00:42:39.115054 tst sms:sysmo: Using 1 x modem (candidates: 2) 00:42:39.231378 tst sms:sysmo: Using 1 x modem (candidates: 2) 00:42:39.351993 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:42:41.059616 run create_hlr_db(pid=20062): Launched 00:42:41.175099 bus /sierra_2: Setting Powered False 00:42:42.234867 run create_hlr_db(pid=20062): Terminated: ok {rc=0} 00:42:42.681037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20064): Launched 00:42:43.003509 run osmo-hlr_10.42.42.2(pid=20065): Launched 00:42:43.119104 run osmo-stp_10.42.42.5: Starting osmo-stp 00:42:45.600737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20067): Launched 00:42:45.912774 run osmo-stp_10.42.42.5(pid=20068): Launched 00:42:46.194153 run osmo-msc_10.42.42.6: Starting osmo-msc 00:42:51.504454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20070): Launched 00:42:51.805326 run osmo-msc_10.42.42.6(pid=20071): Launched 00:42:51.971364 run osmo-stp_10.42.42.5(pid=20068): ERR: Terminated: ERROR {rc=1} [trial-2397↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20068)] 00:42:52.097471 run osmo-stp_10.42.42.5(pid=20068): stdout: | (launched: 2022-12-14_00:42:45.851152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:42:52.222992 run osmo-stp_10.42.42.5(pid=20068): stderr: | [0;m[38;5;43m20221214004246103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004246103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004246103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004246104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004246104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004246104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004246104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:42:52.346506 run osmo-stp_10.42.42.5(pid=20068): stdout: | (launched: 2022-12-14_00:42:45.851152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:42:52.465101 run osmo-stp_10.42.42.5(pid=20068): stderr: | [0;m[38;5;43m20221214004246103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004246103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004246103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004246104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004246104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004246104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004246104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:42:52.606946 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=20068): Process ended prematurely: osmo-stp_10.42.42.5(pid=20068) [trial-2397↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20068)] [trial-2397↪sms:sysmo↪mo_mt_sms.py:16] 00:42:52.615146 tst mo_mt_sms.py:16: Test FAILED (14.1 sec) 00:42:52.641051 run osmo-hlr_10.42.42.2(pid=20065): ERR: Terminated: ERROR {rc=237} [trial-2397↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20065)] 00:42:52.689226 run osmo-hlr_10.42.42.2(pid=20065): stdout: | (launched: 2022-12-14_00:42:42.942770) 00:42:52.738397 run osmo-hlr_10.42.42.2(pid=20065): stderr: | [0;m[1;31m20221214004243121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004243121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004243121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004243121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004243121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004243121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004243156 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004243166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004243166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004243166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:42:52.807000 run osmo-msc_10.42.42.6(pid=20071): ERR: Terminated: ERROR {rc=2} [trial-2397↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20071)] 00:42:52.854604 run osmo-msc_10.42.42.6(pid=20071): stdout: | (launched: 2022-12-14_00:42:51.747603) 00:42:52.903532 run osmo-msc_10.42.42.6(pid=20071): stderr: | [0;m[38;5;43m20221214004252024 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214004252024 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fca3497cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214004252024 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214004252024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214004252024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214004252024 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214004252026 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214004252026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214004252027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214004252027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:42:52.953039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20064): Terminating (SIGTERM) 00:42:52.992807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20067): Terminating (SIGTERM) 00:42:53.032471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20070): Terminating (SIGTERM) 00:42:53.072281 --- ParallelTerminationStrategy: PID 20064 died... 00:42:53.090967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20064): Terminated: ok {rc=0} 00:42:53.134925 --- ParallelTerminationStrategy: PID 20067 died... 00:42:53.154138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20067): Terminated: ok {rc=0} 00:42:53.198091 --- ParallelTerminationStrategy: PID 20070 died... 00:42:53.217193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20070): Terminated: ok {rc=0} 00:42:53.303289 bus /sierra_3: Setting Powered False 00:42:54.407317 bus /sierra_3: Setting Powered False 00:42:55.526861 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 nitb_ussd:sysmo --------------------------------------------------------------------- 00:42:56.744352 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:42:56.748358 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 00:42:56.768911 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 00:42:56.775632 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 00:42:56.810904 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 00:42:56.831463 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 00:42:56.838027 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 00:42:57.357890 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2397 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 00:42:57.362796 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 00:42:57.373545 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 00:42:57.406772 tst assert_extension.py: using LAC 37354 00:42:57.524827 tst assert_extension.py: using RAC 124 00:42:57.640725 tst assert_extension.py: using CellId 37354 00:42:57.755927 tst assert_extension.py: using BVCI 37355 00:42:57.863787 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 00:42:57.982253 tst assert_extension.py:10: start nitb and bts... 00:42:58.199463 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:42:58.855094 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20076): Launched 00:42:59.177505 run osmo-nitb_10.42.42.2(pid=20077): Launched 00:42:59.355291 run osmo-nitb_10.42.42.2(pid=20077): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20077)] 00:42:59.499012 run osmo-nitb_10.42.42.2(pid=20077): stdout: | (launched: 2022-12-14_00:42:59.117405) 00:42:59.644873 run osmo-nitb_10.42.42.2(pid=20077): stderr: | (launched: 2022-12-14_00:42:59.164696) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:42:59.790529 run osmo-nitb_10.42.42.2(pid=20077): stdout: | (launched: 2022-12-14_00:42:59.117405) 00:42:59.930111 run osmo-nitb_10.42.42.2(pid=20077): stderr: | (launched: 2022-12-14_00:42:59.164696) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8b7301f268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20077): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20077) [trial-2397↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20077)] 00:43:00.298713 tst osmo-nitb_10.42.42.2(pid=20077): stdout: | (launched: 2022-12-14_00:42:59.117405) 00:43:00.428903 tst osmo-nitb_10.42.42.2(pid=20077): stderr: | (launched: 2022-12-14_00:42:59.164696) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:43:00.582523 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=20077): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20077) [trial-2397↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20077)] [trial-2397↪nitb_ussd:sysmo↪assert_extension.py:12] 00:43:00.591703 tst assert_extension.py:12: Test FAILED (3.2 sec) 00:43:00.599017 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20076): Terminating (SIGTERM) 00:43:00.810408 --- ParallelTerminationStrategy: PID 20076 died... 00:43:00.834078 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20076): Terminated: ok {rc=0} 00:43:00.949371 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 ussd:sysmo --------------------------------------------------------------------- 00:43:02.115233 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:43:02.119711 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 00:43:02.141710 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 00:43:02.169216 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 00:43:02.203465 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 00:43:02.224742 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 00:43:02.260608 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 00:43:02.779335 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2397 ussd:sysmo assert_extension.py ---------------------------------------------- 00:43:02.786028 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 00:43:02.797912 tst ussd:sysmo: Using 1 x bts (candidates: 1) 00:43:02.833067 tst assert_extension.py: using LAC 37355 00:43:02.964755 tst assert_extension.py: using RAC 125 00:43:03.091622 tst assert_extension.py: using CellId 37355 00:43:03.215477 tst assert_extension.py: using BVCI 37356 00:43:03.333765 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 00:43:03.344837 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 00:43:03.355837 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 00:43:03.366765 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 00:43:03.378030 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 00:43:03.389260 tst ussd:sysmo: Using 1 x modem (candidates: 1) 00:43:03.503306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:43:03.969846 run create_hlr_db(pid=20082): Launched 00:43:04.092381 bus /sierra_2: Setting Powered False 00:43:05.152382 run create_hlr_db(pid=20082): Terminated: ok {rc=0} 00:43:05.596332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20084): Launched 00:43:05.921167 run osmo-hlr_10.42.42.2(pid=20085): Launched 00:43:06.044216 run osmo-stp_10.42.42.5: Starting osmo-stp 00:43:06.579379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20087): Launched 00:43:06.881899 run osmo-stp_10.42.42.5(pid=20088): Launched 00:43:06.995850 run osmo-msc_10.42.42.6: Starting osmo-msc 00:43:07.536016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20090): Launched 00:43:07.837450 run osmo-msc_10.42.42.6(pid=20091): Launched 00:43:08.005312 run osmo-stp_10.42.42.5(pid=20088): ERR: Terminated: ERROR {rc=1} [trial-2397↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20088)] 00:43:08.131781 run osmo-stp_10.42.42.5(pid=20088): stdout: | (launched: 2022-12-14_00:43:06.824349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:08.259499 run osmo-stp_10.42.42.5(pid=20088): stderr: | [0;m[38;5;43m20221214004306998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004306998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004306999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004306999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004307000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004307000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004307001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:08.384305 run osmo-stp_10.42.42.5(pid=20088): stdout: | (launched: 2022-12-14_00:43:06.824349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:08.503462 run osmo-stp_10.42.42.5(pid=20088): stderr: | [0;m[38;5;43m20221214004306998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004306998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004306999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004306999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004307000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004307000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004307001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:08.646407 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=20088): Process ended prematurely: osmo-stp_10.42.42.5(pid=20088) [trial-2397↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20088)] [trial-2397↪ussd:sysmo↪assert_extension.py:17] 00:43:08.654544 tst assert_extension.py:17: Test FAILED (5.9 sec) 00:43:08.680361 run osmo-hlr_10.42.42.2(pid=20085): ERR: Terminated: ERROR {rc=237} [trial-2397↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20085)] 00:43:08.728592 run osmo-hlr_10.42.42.2(pid=20085): stdout: | (launched: 2022-12-14_00:43:05.860422) 00:43:08.777933 run osmo-hlr_10.42.42.2(pid=20085): stderr: | [0;m[1;31m20221214004306060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004306060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004306060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004306060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004306060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004306060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004306074 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004306082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004306082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004306082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:43:08.846472 run osmo-msc_10.42.42.6(pid=20091): ERR: Terminated: ERROR {rc=2} [trial-2397↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20091)] 00:43:08.894268 run osmo-msc_10.42.42.6(pid=20091): stdout: | (launched: 2022-12-14_00:43:07.779934) 00:43:08.943437 run osmo-msc_10.42.42.6(pid=20091): stderr: | [0;m[38;5;43m20221214004308054 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214004308054 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4d31dc5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214004308054 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214004308054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214004308054 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214004308055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214004308056 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214004308057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214004308057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214004308057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:43:08.993146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20084): Terminating (SIGTERM) 00:43:09.033205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20087): Terminating (SIGTERM) 00:43:09.072723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20090): Terminating (SIGTERM) 00:43:09.112556 --- ParallelTerminationStrategy: PID 20084 died... 00:43:09.131690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20084): Terminated: ok {rc=0} 00:43:09.175483 --- ParallelTerminationStrategy: PID 20087 died... 00:43:09.194165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20087): Terminated: ok {rc=0} 00:43:09.237758 --- ParallelTerminationStrategy: PID 20090 died... 00:43:09.256246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20090): Terminated: ok {rc=0} 00:43:09.339940 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 00:43:10.547429 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:43:10.555001 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 00:43:10.577152 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 00:43:10.605885 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 00:43:10.659391 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 00:43:10.681428 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 00:43:10.709633 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 00:43:11.262781 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 00:43:11.320141 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:11.331598 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:43:11.394131 tst mo_mt_call.py: using LAC 37356 00:43:11.522396 tst mo_mt_call.py: using RAC 126 00:43:11.642783 tst mo_mt_call.py: using CellId 37356 00:43:11.763204 tst mo_mt_call.py: using BVCI 37357 00:43:11.874556 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:11.886114 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:11.897258 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:11.908282 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:11.919180 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:11.930149 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:43:12.050776 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:43:12.167396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:43:12.641668 run create_hlr_db(pid=20096): Launched 00:43:12.766787 bus /sierra_2: Setting Powered False 00:43:13.827151 run create_hlr_db(pid=20096): Terminated: ok {rc=0} 00:43:14.255645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20098): Launched 00:43:14.562783 run osmo-hlr_10.42.42.2(pid=20099): Launched 00:43:14.678347 run osmo-stp_10.42.42.5: Starting osmo-stp 00:43:15.204468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20101): Launched 00:43:15.510385 run osmo-stp_10.42.42.5(pid=20102): Launched 00:43:15.625329 run osmo-msc_10.42.42.6: Starting osmo-msc 00:43:16.235535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20104): Launched 00:43:16.563804 run osmo-msc_10.42.42.6(pid=20105): Launched 00:43:16.909076 run osmo-stp_10.42.42.5(pid=20102): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20102)] 00:43:17.166178 run osmo-stp_10.42.42.5(pid=20102): stdout: | (launched: 2022-12-14_00:43:15.452460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:17.329818 run osmo-stp_10.42.42.5(pid=20102): stderr: | [0;m[38;5;43m20221214004315627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004315627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004315627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004315628 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004315630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004315630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004315630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:17.475497 run osmo-stp_10.42.42.5(pid=20102): stdout: | (launched: 2022-12-14_00:43:15.452460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:17.606822 run osmo-stp_10.42.42.5(pid=20102): stderr: | [0;m[38;5;43m20221214004315627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004315627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004315627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004315628 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004315630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004315630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004315630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:17.763229 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20102): Process ended prematurely: osmo-stp_10.42.42.5(pid=20102) [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20102)] [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 00:43:17.772718 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 00:43:17.800417 run osmo-hlr_10.42.42.2(pid=20099): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20099)] 00:43:17.851410 run osmo-hlr_10.42.42.2(pid=20099): stdout: | (launched: 2022-12-14_00:43:14.504332) 00:43:17.903302 run osmo-hlr_10.42.42.2(pid=20099): stderr: | [0;m[1;31m20221214004314687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004314687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004314687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004314687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004314687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004314687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004314713 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004314722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004314723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004314723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:43:17.976120 run osmo-msc_10.42.42.6(pid=20105): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20105)] 00:43:18.026509 run osmo-msc_10.42.42.6(pid=20105): stdout: | (launched: 2022-12-14_00:43:16.501264) 00:43:18.078641 run osmo-msc_10.42.42.6(pid=20105): stderr: | [0;m[38;5;43m20221214004317090 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214004317090 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb9193f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214004317090 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214004317091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214004317091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214004317091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214004317105 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214004317105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214004317105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214004317105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:43:18.131337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20098): Terminating (SIGTERM) 00:43:18.173566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20101): Terminating (SIGTERM) 00:43:18.216122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20104): Terminating (SIGTERM) 00:43:18.258963 --- ParallelTerminationStrategy: PID 20098 died... 00:43:18.279503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20098): Terminated: ok {rc=0} 00:43:18.326337 --- ParallelTerminationStrategy: PID 20101 died... 00:43:18.346141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20101): Terminated: ok {rc=0} 00:43:18.392537 --- ParallelTerminationStrategy: PID 20104 died... 00:43:18.412398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20104): Terminated: ok {rc=0} 00:43:18.501087 bus /sierra_3: Setting Powered False 00:43:19.599300 bus /sierra_3: Setting Powered False 00:43:20.714627 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 00:43:21.865712 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:21.877980 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:43:21.950600 tst mo_mt_call_osmux.py: using LAC 37357 00:43:22.079623 tst mo_mt_call_osmux.py: using RAC 127 00:43:22.198486 tst mo_mt_call_osmux.py: using CellId 37357 00:43:22.318165 tst mo_mt_call_osmux.py: using BVCI 37358 00:43:22.435434 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:22.447641 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:22.459525 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:22.471355 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:22.483231 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:43:22.494849 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:43:22.615880 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:43:22.733325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:43:23.208396 run create_hlr_db(pid=20107): Launched 00:43:23.333473 bus /sierra_2: Setting Powered False 00:43:24.394549 run create_hlr_db(pid=20107): Terminated: ok {rc=0} 00:43:24.822712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20109): Launched 00:43:25.130942 run osmo-hlr_10.42.42.2(pid=20110): Launched 00:43:25.247348 run osmo-stp_10.42.42.5: Starting osmo-stp 00:43:25.778088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20112): Launched 00:43:26.084863 run osmo-stp_10.42.42.5(pid=20113): Launched 00:43:26.200195 run osmo-msc_10.42.42.6: Starting osmo-msc 00:43:26.754725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20115): Launched 00:43:27.064256 run osmo-msc_10.42.42.6(pid=20116): Launched 00:43:27.235506 run osmo-stp_10.42.42.5(pid=20113): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20113)] 00:43:27.364400 run osmo-stp_10.42.42.5(pid=20113): stdout: | (launched: 2022-12-14_00:43:26.026886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:27.493395 run osmo-stp_10.42.42.5(pid=20113): stderr: | [0;m[38;5;43m20221214004326196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004326196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004326196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004326196 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004326197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004326197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004326197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:27.620255 run osmo-stp_10.42.42.5(pid=20113): stdout: | (launched: 2022-12-14_00:43:26.026886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:27.740758 run osmo-stp_10.42.42.5(pid=20113): stderr: | [0;m[38;5;43m20221214004326196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004326196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004326196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004326196 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004326197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004326197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004326197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:27.885650 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20113): Process ended prematurely: osmo-stp_10.42.42.5(pid=20113) [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20113)] [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 00:43:27.894441 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 00:43:27.920597 run osmo-hlr_10.42.42.2(pid=20110): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20110)] 00:43:27.969173 run osmo-hlr_10.42.42.2(pid=20110): stdout: | (launched: 2022-12-14_00:43:25.073121) 00:43:28.018645 run osmo-hlr_10.42.42.2(pid=20110): stderr: | [0;m[1;31m20221214004325248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004325248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004325248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004325248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004325248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004325248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004325259 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004325267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004325267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004325268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:43:28.087696 run osmo-msc_10.42.42.6(pid=20116): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20116)] 00:43:28.135415 run osmo-msc_10.42.42.6(pid=20116): stdout: | (launched: 2022-12-14_00:43:27.006340) 00:43:28.184877 run osmo-msc_10.42.42.6(pid=20116): stderr: | [0;m[38;5;43m20221214004327277 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214004327277 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4f2d6bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214004327277 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214004327278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214004327278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214004327278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214004327280 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214004327280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214004327280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214004327280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:43:28.234535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20109): Terminating (SIGTERM) 00:43:28.273956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20112): Terminating (SIGTERM) 00:43:28.313496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20115): Terminating (SIGTERM) 00:43:28.353268 --- ParallelTerminationStrategy: PID 20109 died... 00:43:28.372803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20109): Terminated: ok {rc=0} 00:43:28.416895 --- ParallelTerminationStrategy: PID 20112 died... 00:43:28.435643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20112): Terminated: ok {rc=0} 00:43:28.479382 --- ParallelTerminationStrategy: PID 20115 died... 00:43:28.498023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20115): Terminated: ok {rc=0} 00:43:28.583723 bus /sierra_3: Setting Powered False 00:43:29.683561 bus /sierra_3: Setting Powered False 00:43:30.801221 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 00:43:32.078618 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:43:32.085347 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 00:43:32.107705 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 00:43:32.135243 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 00:43:32.187240 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 00:43:32.209972 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 00:43:32.238713 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 00:43:32.787902 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 00:43:32.836718 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:32.847911 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:43:32.903905 tst mo_mt_call.py: using LAC 37358 00:43:33.025630 tst mo_mt_call.py: using RAC 128 00:43:33.145533 tst mo_mt_call.py: using CellId 37358 00:43:33.266662 tst mo_mt_call.py: using BVCI 37359 00:43:33.378635 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:33.389851 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:33.400641 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:33.411509 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:33.422416 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:33.433276 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:43:33.554248 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:43:33.671745 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:43:34.145440 run create_hlr_db(pid=20121): Launched 00:43:34.270473 bus /sierra_2: Setting Powered False 00:43:35.331699 run create_hlr_db(pid=20121): Terminated: ok {rc=0} 00:43:35.759787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20123): Launched 00:43:36.068347 run osmo-hlr_10.42.42.2(pid=20124): Launched 00:43:36.182539 run osmo-stp_10.42.42.5: Starting osmo-stp 00:43:36.724854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20126): Launched 00:43:37.034902 run osmo-stp_10.42.42.5(pid=20127): Launched 00:43:37.151066 run osmo-msc_10.42.42.6: Starting osmo-msc 00:43:37.702937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20129): Launched 00:43:38.011580 run osmo-msc_10.42.42.6(pid=20130): Launched 00:43:38.183018 run osmo-stp_10.42.42.5(pid=20127): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20127)] 00:43:38.312336 run osmo-stp_10.42.42.5(pid=20127): stdout: | (launched: 2022-12-14_00:43:36.977337) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:38.440578 run osmo-stp_10.42.42.5(pid=20127): stderr: | [0;m[38;5;43m20221214004337147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004337147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004337148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004337148 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004337149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004337149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004337149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:38.567634 run osmo-stp_10.42.42.5(pid=20127): stdout: | (launched: 2022-12-14_00:43:36.977337) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:38.688290 run osmo-stp_10.42.42.5(pid=20127): stderr: | [0;m[38;5;43m20221214004337147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004337147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004337148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004337148 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004337149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004337149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004337149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:38.833116 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20127): Process ended prematurely: osmo-stp_10.42.42.5(pid=20127) [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20127)] [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 00:43:38.842068 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 00:43:38.867928 run osmo-hlr_10.42.42.2(pid=20124): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20124)] 00:43:38.915423 run osmo-hlr_10.42.42.2(pid=20124): stdout: | (launched: 2022-12-14_00:43:36.010639) 00:43:38.964317 run osmo-hlr_10.42.42.2(pid=20124): stderr: | [0;m[1;31m20221214004336186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004336186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004336186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004336186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004336186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004336186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004336198 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004336207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004336207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004336207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:43:39.032774 run osmo-msc_10.42.42.6(pid=20130): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20130)] 00:43:39.080181 run osmo-msc_10.42.42.6(pid=20130): stdout: | (launched: 2022-12-14_00:43:37.953651) 00:43:39.129501 run osmo-msc_10.42.42.6(pid=20130): stderr: | [0;m[38;5;43m20221214004338226 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214004338226 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f64d200cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214004338226 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214004338226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214004338227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214004338227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214004338228 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214004338229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214004338229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214004338229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:43:39.178710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20123): Terminating (SIGTERM) 00:43:39.218080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20126): Terminating (SIGTERM) 00:43:39.257475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20129): Terminating (SIGTERM) 00:43:39.297080 --- ParallelTerminationStrategy: PID 20123 died... 00:43:39.316094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20123): Terminated: ok {rc=0} 00:43:39.360167 --- ParallelTerminationStrategy: PID 20126 died... 00:43:39.378706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20126): Terminated: ok {rc=0} 00:43:39.422316 --- ParallelTerminationStrategy: PID 20129 died... 00:43:39.440748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20129): Terminated: ok {rc=0} 00:43:39.526144 bus /sierra_3: Setting Powered False 00:43:40.625381 bus /sierra_3: Setting Powered False 00:43:41.740104 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 00:43:42.886489 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:42.898231 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:43:42.954624 tst mo_mt_call_osmux.py: using LAC 37359 00:43:43.073364 tst mo_mt_call_osmux.py: using RAC 129 00:43:43.192603 tst mo_mt_call_osmux.py: using CellId 37359 00:43:43.312128 tst mo_mt_call_osmux.py: using BVCI 37360 00:43:43.422579 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:43.433695 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:43.444491 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:43.455327 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:43.466148 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:43:43.477032 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:43:43.596773 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:43:43.718289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:43:44.228525 run create_hlr_db(pid=20132): Launched 00:43:44.356399 bus /sierra_2: Setting Powered False 00:43:45.421539 run create_hlr_db(pid=20132): Terminated: ok {rc=0} 00:43:45.893613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20134): Launched 00:43:46.239920 run osmo-hlr_10.42.42.2(pid=20135): Launched 00:43:46.483520 run osmo-stp_10.42.42.5: Starting osmo-stp 00:43:47.083259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20137): Launched 00:43:47.407300 run osmo-stp_10.42.42.5(pid=20138): Launched 00:43:47.526208 run osmo-msc_10.42.42.6: Starting osmo-msc 00:43:48.081469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20140): Launched 00:43:48.389295 run osmo-msc_10.42.42.6(pid=20141): Launched 00:43:48.559050 run osmo-stp_10.42.42.5(pid=20138): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20138)] 00:43:48.686594 run osmo-stp_10.42.42.5(pid=20138): stdout: | (launched: 2022-12-14_00:43:47.349627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:48.814126 run osmo-stp_10.42.42.5(pid=20138): stderr: | [0;m[38;5;43m20221214004347520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004347520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004347521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004347521 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004347522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004347522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004347522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:48.940736 run osmo-stp_10.42.42.5(pid=20138): stdout: | (launched: 2022-12-14_00:43:47.349627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:49.061748 run osmo-stp_10.42.42.5(pid=20138): stderr: | [0;m[38;5;43m20221214004347520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004347520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004347521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004347521 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004347522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004347522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004347522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:49.206679 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20138): Process ended prematurely: osmo-stp_10.42.42.5(pid=20138) [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20138)] [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 00:43:49.215691 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 00:43:49.241954 run osmo-hlr_10.42.42.2(pid=20135): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20135)] 00:43:49.289373 run osmo-hlr_10.42.42.2(pid=20135): stdout: | (launched: 2022-12-14_00:43:46.178374) 00:43:49.338427 run osmo-hlr_10.42.42.2(pid=20135): stderr: | [0;m[1;31m20221214004346387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004346387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004346387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004346387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004346387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004346387 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004346403 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004346419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004346420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004346420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:43:49.406756 run osmo-msc_10.42.42.6(pid=20141): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20141)] 00:43:49.453943 run osmo-msc_10.42.42.6(pid=20141): stdout: | (launched: 2022-12-14_00:43:48.331586) 00:43:49.502741 run osmo-msc_10.42.42.6(pid=20141): stderr: | [0;m[38;5;43m20221214004348606 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214004348606 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f25c2b12c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214004348606 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214004348606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214004348606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214004348607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214004348608 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214004348610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214004348610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214004348610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:43:49.551819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20134): Terminating (SIGTERM) 00:43:49.591100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20137): Terminating (SIGTERM) 00:43:49.630345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20140): Terminating (SIGTERM) 00:43:49.669800 --- ParallelTerminationStrategy: PID 20134 died... 00:43:49.688796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20134): Terminated: ok {rc=0} 00:43:49.732389 --- ParallelTerminationStrategy: PID 20137 died... 00:43:49.750998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20137): Terminated: ok {rc=0} 00:43:49.794314 --- ParallelTerminationStrategy: PID 20140 died... 00:43:49.813106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20140): Terminated: ok {rc=0} 00:43:49.898572 bus /sierra_3: Setting Powered False 00:43:50.997354 bus /sierra_3: Setting Powered False 00:43:52.111622 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 00:43:53.350045 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:43:53.357220 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 00:43:53.378782 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 00:43:53.406945 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 00:43:53.460664 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 00:43:53.482489 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 00:43:53.510041 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 00:43:54.059276 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 00:43:54.108459 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:43:54.119660 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:43:54.175007 tst mo_mt_call.py: using LAC 37360 00:43:54.296540 tst mo_mt_call.py: using RAC 130 00:43:54.417625 tst mo_mt_call.py: using CellId 37360 00:43:54.537290 tst mo_mt_call.py: using BVCI 37361 00:43:54.648477 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:43:54.659675 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:43:54.670583 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:43:54.681479 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:43:54.692227 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:43:54.703157 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:43:54.824209 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:43:54.946496 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:43:55.457563 run create_hlr_db(pid=20146): Launched 00:43:55.585403 bus /sierra_2: Setting Powered False 00:43:56.646570 run create_hlr_db(pid=20146): Terminated: ok {rc=0} 00:43:57.086486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20148): Launched 00:43:57.394020 run osmo-hlr_10.42.42.2(pid=20149): Launched 00:43:57.509918 run osmo-stp_10.42.42.5: Starting osmo-stp 00:43:58.041852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20151): Launched 00:43:58.348897 run osmo-stp_10.42.42.5(pid=20152): Launched 00:43:58.466935 run osmo-msc_10.42.42.6: Starting osmo-msc 00:43:59.020184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20154): Launched 00:43:59.329131 run osmo-msc_10.42.42.6(pid=20155): Launched 00:43:59.499534 run osmo-stp_10.42.42.5(pid=20152): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20152)] 00:43:59.628752 run osmo-stp_10.42.42.5(pid=20152): stdout: | (launched: 2022-12-14_00:43:58.291154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:43:59.757965 run osmo-stp_10.42.42.5(pid=20152): stderr: | [0;m[38;5;43m20221214004358463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004358463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004358463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004358464 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004358464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004358464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004358464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:43:59.884809 run osmo-stp_10.42.42.5(pid=20152): stdout: | (launched: 2022-12-14_00:43:58.291154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:00.006276 run osmo-stp_10.42.42.5(pid=20152): stderr: | [0;m[38;5;43m20221214004358463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004358463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004358463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004358464 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004358464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004358464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004358464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:00.151880 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20152): Process ended prematurely: osmo-stp_10.42.42.5(pid=20152) [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20152)] [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 00:44:00.160631 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 00:44:00.186732 run osmo-hlr_10.42.42.2(pid=20149): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20149)] 00:44:00.234325 run osmo-hlr_10.42.42.2(pid=20149): stdout: | (launched: 2022-12-14_00:43:57.335502) 00:44:00.283289 run osmo-hlr_10.42.42.2(pid=20149): stderr: | [0;m[1;31m20221214004357514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004357514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004357514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004357514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004357515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004357515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004357530 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004357538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004357538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004357539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:44:00.351765 run osmo-msc_10.42.42.6(pid=20155): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20155)] 00:44:00.398913 run osmo-msc_10.42.42.6(pid=20155): stdout: | (launched: 2022-12-14_00:43:59.270999) 00:44:00.447893 run osmo-msc_10.42.42.6(pid=20155): stderr: | [0;m[38;5;43m20221214004359544 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214004359544 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f38697f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214004359545 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214004359545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214004359545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214004359545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214004359547 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214004359547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214004359547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214004359547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:44:00.497248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20148): Terminating (SIGTERM) 00:44:00.536330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20151): Terminating (SIGTERM) 00:44:00.575552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20154): Terminating (SIGTERM) 00:44:00.614872 --- ParallelTerminationStrategy: PID 20148 died... 00:44:00.634264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20148): Terminated: ok {rc=0} 00:44:00.677798 --- ParallelTerminationStrategy: PID 20151 died... 00:44:00.696166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20151): Terminated: ok {rc=0} 00:44:00.739835 --- ParallelTerminationStrategy: PID 20154 died... 00:44:00.758400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20154): Terminated: ok {rc=0} 00:44:00.848659 bus /sierra_3: Setting Powered False 00:44:01.951160 bus /sierra_3: Setting Powered False 00:44:03.064019 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 00:44:04.214658 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:44:04.227110 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:44:04.289390 tst mo_mt_call_osmux.py: using LAC 37361 00:44:04.417376 tst mo_mt_call_osmux.py: using RAC 131 00:44:04.543480 tst mo_mt_call_osmux.py: using CellId 37361 00:44:04.670302 tst mo_mt_call_osmux.py: using BVCI 37362 00:44:04.789686 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:44:04.801268 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:44:04.812691 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:44:04.824044 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:44:04.835591 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:44:04.847263 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:44:04.965995 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:44:05.085498 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:44:05.596288 run create_hlr_db(pid=20157): Launched 00:44:05.722879 bus /sierra_2: Setting Powered False 00:44:06.787560 run create_hlr_db(pid=20157): Terminated: ok {rc=0} 00:44:07.227717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20159): Launched 00:44:07.536806 run osmo-hlr_10.42.42.2(pid=20160): Launched 00:44:07.655850 run osmo-stp_10.42.42.5: Starting osmo-stp 00:44:08.189180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20162): Launched 00:44:08.496564 run osmo-stp_10.42.42.5(pid=20163): Launched 00:44:08.614510 run osmo-msc_10.42.42.6: Starting osmo-msc 00:44:09.167265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20165): Launched 00:44:09.476381 run osmo-msc_10.42.42.6(pid=20166): Launched 00:44:09.648034 run osmo-stp_10.42.42.5(pid=20163): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20163)] 00:44:09.776586 run osmo-stp_10.42.42.5(pid=20163): stdout: | (launched: 2022-12-14_00:44:08.438945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:09.905782 run osmo-stp_10.42.42.5(pid=20163): stderr: | [0;m[38;5;43m20221214004408610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004408610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004408611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004408611 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004408611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004408612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004408612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:10.032792 run osmo-stp_10.42.42.5(pid=20163): stdout: | (launched: 2022-12-14_00:44:08.438945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:10.154305 run osmo-stp_10.42.42.5(pid=20163): stderr: | [0;m[38;5;43m20221214004408610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004408610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004408611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004408611 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004408611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004408612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004408612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:10.299302 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20163): Process ended prematurely: osmo-stp_10.42.42.5(pid=20163) [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20163)] [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 00:44:10.308290 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 00:44:10.334409 run osmo-hlr_10.42.42.2(pid=20160): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20160)] 00:44:10.382363 run osmo-hlr_10.42.42.2(pid=20160): stdout: | (launched: 2022-12-14_00:44:07.478821) 00:44:10.431426 run osmo-hlr_10.42.42.2(pid=20160): stderr: | [0;m[1;31m20221214004407658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004407658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004407658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004407658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004407658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004407658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004407670 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004407678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004407678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004407678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:44:10.499335 run osmo-msc_10.42.42.6(pid=20166): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20166)] 00:44:10.546818 run osmo-msc_10.42.42.6(pid=20166): stdout: | (launched: 2022-12-14_00:44:09.418294) 00:44:10.595652 run osmo-msc_10.42.42.6(pid=20166): stderr: | [0;m[38;5;43m20221214004409694 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214004409694 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fea9edadc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214004409694 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214004409694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214004409694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214004409695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214004409696 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214004409697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214004409697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214004409697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:44:10.644732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20159): Terminating (SIGTERM) 00:44:10.684102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20162): Terminating (SIGTERM) 00:44:10.723848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20165): Terminating (SIGTERM) 00:44:10.763663 --- ParallelTerminationStrategy: PID 20159 died... 00:44:10.782784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20159): Terminated: ok {rc=0} 00:44:10.826296 --- ParallelTerminationStrategy: PID 20162 died... 00:44:10.844818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20162): Terminated: ok {rc=0} 00:44:10.888519 --- ParallelTerminationStrategy: PID 20165 died... 00:44:10.907087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20165): Terminated: ok {rc=0} 00:44:10.992282 bus /sierra_3: Setting Powered False 00:44:12.093299 bus /sierra_3: Setting Powered False 00:44:13.209114 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 00:44:14.452131 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:44:14.460045 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 00:44:14.480871 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 00:44:14.507454 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 00:44:14.558786 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 00:44:14.579829 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 00:44:14.606509 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 00:44:15.158491 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 00:44:15.210125 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:15.221249 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 00:44:15.275722 tst mo_mt_call.py: using LAC 37362 00:44:15.395954 tst mo_mt_call.py: using RAC 132 00:44:15.514141 tst mo_mt_call.py: using CellId 37362 00:44:15.634934 tst mo_mt_call.py: using BVCI 37363 00:44:15.746211 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:15.757342 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:15.768106 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:15.778880 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:15.789883 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:15.800825 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:44:15.931409 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:44:16.068807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:44:16.557689 run create_hlr_db(pid=20171): Launched 00:44:16.715435 bus /sierra_2: Setting Powered False 00:44:17.777089 run create_hlr_db(pid=20171): Terminated: ok {rc=0} 00:44:18.228187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20173): Launched 00:44:18.560245 run osmo-hlr_10.42.42.2(pid=20174): Launched 00:44:18.688693 run osmo-stp_10.42.42.5: Starting osmo-stp 00:44:19.259247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20176): Launched 00:44:19.588877 run osmo-stp_10.42.42.5(pid=20177): Launched 00:44:19.716533 run osmo-msc_10.42.42.6: Starting osmo-msc 00:44:20.312411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20179): Launched 00:44:20.642941 run osmo-msc_10.42.42.6(pid=20180): Launched 00:44:20.827356 run osmo-stp_10.42.42.5(pid=20177): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20177)] 00:44:20.967095 run osmo-stp_10.42.42.5(pid=20177): stdout: | (launched: 2022-12-14_00:44:19.527566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:21.107532 run osmo-stp_10.42.42.5(pid=20177): stderr: | [0;m[38;5;43m20221214004419716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004419716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004419717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004419717 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004419717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004419718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004419718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:21.244660 run osmo-stp_10.42.42.5(pid=20177): stdout: | (launched: 2022-12-14_00:44:19.527566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:21.375291 run osmo-stp_10.42.42.5(pid=20177): stderr: | [0;m[38;5;43m20221214004419716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004419716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004419717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004419717 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004419717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004419718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004419718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:21.531464 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20177): Process ended prematurely: osmo-stp_10.42.42.5(pid=20177) [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20177)] [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 00:44:21.541286 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 00:44:21.568717 run osmo-hlr_10.42.42.2(pid=20174): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20174)] 00:44:21.619167 run osmo-hlr_10.42.42.2(pid=20174): stdout: | (launched: 2022-12-14_00:44:18.498845) 00:44:21.670751 run osmo-hlr_10.42.42.2(pid=20174): stderr: | [0;m[1;31m20221214004418694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004418694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004418694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004418694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004418694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004418694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004418705 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004418714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004418714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004418714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:44:21.742620 run osmo-msc_10.42.42.6(pid=20180): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20180)] 00:44:21.792256 run osmo-msc_10.42.42.6(pid=20180): stdout: | (launched: 2022-12-14_00:44:20.581252) 00:44:21.843700 run osmo-msc_10.42.42.6(pid=20180): stderr: | [0;m[38;5;43m20221214004420902 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214004420902 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5dc0937c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214004420902 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214004420902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214004420902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214004420902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214004420904 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214004420904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214004420905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214004420905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:44:21.895807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20173): Terminating (SIGTERM) 00:44:21.937481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20176): Terminating (SIGTERM) 00:44:21.979241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20179): Terminating (SIGTERM) 00:44:22.022154 --- ParallelTerminationStrategy: PID 20173 died... 00:44:22.042553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20173): Terminated: ok {rc=0} 00:44:22.089117 --- ParallelTerminationStrategy: PID 20176 died... 00:44:22.108862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20176): Terminated: ok {rc=0} 00:44:22.155327 --- ParallelTerminationStrategy: PID 20179 died... 00:44:22.175308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20179): Terminated: ok {rc=0} 00:44:22.263773 bus /sierra_3: Setting Powered False 00:44:23.360460 bus /sierra_3: Setting Powered False 00:44:24.475031 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 00:44:25.621901 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:25.633742 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 00:44:25.690324 tst mo_mt_call_osmux.py: using LAC 37363 00:44:25.811014 tst mo_mt_call_osmux.py: using RAC 133 00:44:25.930599 tst mo_mt_call_osmux.py: using CellId 37363 00:44:26.051606 tst mo_mt_call_osmux.py: using BVCI 37364 00:44:26.164414 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:26.175574 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:26.186501 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:26.197345 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:26.208182 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:44:26.219048 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:44:26.339735 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:44:26.457185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:44:26.936314 run create_hlr_db(pid=20182): Launched 00:44:27.059982 bus /sierra_2: Setting Powered False 00:44:28.122266 run create_hlr_db(pid=20182): Terminated: ok {rc=0} 00:44:28.572880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20184): Launched 00:44:28.905581 run osmo-hlr_10.42.42.2(pid=20185): Launched 00:44:29.032870 run osmo-stp_10.42.42.5: Starting osmo-stp 00:44:29.604349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20187): Launched 00:44:29.935880 run osmo-stp_10.42.42.5(pid=20188): Launched 00:44:30.061914 run osmo-msc_10.42.42.6: Starting osmo-msc 00:44:30.656913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20190): Launched 00:44:31.025358 run osmo-msc_10.42.42.6(pid=20191): Launched 00:44:31.522268 run osmo-stp_10.42.42.5(pid=20188): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20188)] 00:44:31.653355 run osmo-stp_10.42.42.5(pid=20188): stdout: | (launched: 2022-12-14_00:44:29.874242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:31.784368 run osmo-stp_10.42.42.5(pid=20188): stderr: | [0;m[38;5;43m20221214004430065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004430065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004430065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004430066 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004430066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004430066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004430066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:31.915711 run osmo-stp_10.42.42.5(pid=20188): stdout: | (launched: 2022-12-14_00:44:29.874242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:32.041951 run osmo-stp_10.42.42.5(pid=20188): stderr: | [0;m[38;5;43m20221214004430065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004430065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004430065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004430066 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004430066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004430066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004430066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:32.189748 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20188): Process ended prematurely: osmo-stp_10.42.42.5(pid=20188) [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20188)] [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 00:44:32.199352 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 00:44:32.227953 run osmo-hlr_10.42.42.2(pid=20185): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20185)] 00:44:32.277453 run osmo-hlr_10.42.42.2(pid=20185): stdout: | (launched: 2022-12-14_00:44:28.843581) 00:44:32.328477 run osmo-hlr_10.42.42.2(pid=20185): stderr: | [0;m[1;31m20221214004429040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004429040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004429040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004429040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004429040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004429040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004429052 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004429061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004429061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004429061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:44:32.399345 run osmo-msc_10.42.42.6(pid=20191): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20191)] 00:44:32.447577 run osmo-msc_10.42.42.6(pid=20191): stdout: | (launched: 2022-12-14_00:44:30.959107) 00:44:32.498332 run osmo-msc_10.42.42.6(pid=20191): stderr: | [0;m[38;5;43m20221214004431283 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214004431283 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0597170c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214004431283 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214004431283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214004431284 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214004431284 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214004431286 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214004431287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214004431287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214004431287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:44:32.548740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20184): Terminating (SIGTERM) 00:44:32.589188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20187): Terminating (SIGTERM) 00:44:32.629413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20190): Terminating (SIGTERM) 00:44:32.669789 --- ParallelTerminationStrategy: PID 20184 died... 00:44:32.689398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20184): Terminated: ok {rc=0} 00:44:32.733882 --- ParallelTerminationStrategy: PID 20187 died... 00:44:32.753138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20187): Terminated: ok {rc=0} 00:44:32.797456 --- ParallelTerminationStrategy: PID 20190 died... 00:44:32.816492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20190): Terminated: ok {rc=0} 00:44:32.903614 bus /sierra_3: Setting Powered False 00:44:34.007437 bus /sierra_3: Setting Powered False 00:44:35.126928 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 00:44:36.365989 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:44:36.373204 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 00:44:36.394686 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 00:44:36.423277 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 00:44:36.479757 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 00:44:36.501480 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 00:44:36.527754 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 00:44:37.078393 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 00:44:37.131202 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:37.142899 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:44:37.201354 tst mo_mt_call.py: using LAC 37364 00:44:37.329650 tst mo_mt_call.py: using RAC 134 00:44:37.452145 tst mo_mt_call.py: using CellId 37364 00:44:37.573446 tst mo_mt_call.py: using BVCI 37365 00:44:37.683657 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:37.694965 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:37.706034 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:37.717033 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:37.727864 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:37.738945 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:44:37.860506 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:44:37.977552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:44:38.454872 run create_hlr_db(pid=20196): Launched 00:44:38.581215 bus /sierra_2: Setting Powered False 00:44:39.642121 run create_hlr_db(pid=20196): Terminated: ok {rc=0} 00:44:40.070107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20198): Launched 00:44:40.377329 run osmo-hlr_10.42.42.2(pid=20199): Launched 00:44:40.494095 run osmo-stp_10.42.42.5: Starting osmo-stp 00:44:41.019983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20201): Launched 00:44:41.327476 run osmo-stp_10.42.42.5(pid=20202): Launched 00:44:41.444399 run osmo-msc_10.42.42.6: Starting osmo-msc 00:44:41.999346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20204): Launched 00:44:42.310363 run osmo-msc_10.42.42.6(pid=20205): Launched 00:44:42.480804 run osmo-stp_10.42.42.5(pid=20202): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20202)] 00:44:42.609522 run osmo-stp_10.42.42.5(pid=20202): stdout: | (launched: 2022-12-14_00:44:41.269555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:42.738361 run osmo-stp_10.42.42.5(pid=20202): stderr: | [0;m[38;5;43m20221214004441441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004441441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004441441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004441442 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004441442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004441442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004441442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:42.865358 run osmo-stp_10.42.42.5(pid=20202): stdout: | (launched: 2022-12-14_00:44:41.269555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:42.987292 run osmo-stp_10.42.42.5(pid=20202): stderr: | [0;m[38;5;43m20221214004441441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004441441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004441441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004441442 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004441442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004441442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004441442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:43.132501 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20202): Process ended prematurely: osmo-stp_10.42.42.5(pid=20202) [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20202)] [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 00:44:43.141644 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 00:44:43.167740 run osmo-hlr_10.42.42.2(pid=20199): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20199)] 00:44:43.215221 run osmo-hlr_10.42.42.2(pid=20199): stdout: | (launched: 2022-12-14_00:44:40.319492) 00:44:43.264458 run osmo-hlr_10.42.42.2(pid=20199): stderr: | [0;m[1;31m20221214004440498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004440499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004440499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004440499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004440499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004440499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004440511 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004440520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004440520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004440520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:44:43.332639 run osmo-msc_10.42.42.6(pid=20205): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20205)] 00:44:43.379662 run osmo-msc_10.42.42.6(pid=20205): stdout: | (launched: 2022-12-14_00:44:42.252159) 00:44:43.428297 run osmo-msc_10.42.42.6(pid=20205): stderr: | [0;m[38;5;43m20221214004442526 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214004442526 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2f7c5b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214004442526 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214004442526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214004442526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214004442526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214004442528 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214004442529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214004442529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214004442529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:44:43.478418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20198): Terminating (SIGTERM) 00:44:43.517734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20201): Terminating (SIGTERM) 00:44:43.557077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20204): Terminating (SIGTERM) 00:44:43.596891 --- ParallelTerminationStrategy: PID 20198 died... 00:44:43.615982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20198): Terminated: ok {rc=0} 00:44:43.659575 --- ParallelTerminationStrategy: PID 20201 died... 00:44:43.678371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20201): Terminated: ok {rc=0} 00:44:43.722243 --- ParallelTerminationStrategy: PID 20204 died... 00:44:43.740893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20204): Terminated: ok {rc=0} 00:44:43.827304 bus /sierra_3: Setting Powered False 00:44:44.926021 bus /sierra_3: Setting Powered False 00:44:46.042300 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 00:44:47.186036 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:47.198184 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:44:47.254446 tst mo_mt_call_osmux.py: using LAC 37365 00:44:47.372716 tst mo_mt_call_osmux.py: using RAC 135 00:44:47.491393 tst mo_mt_call_osmux.py: using CellId 37365 00:44:47.608838 tst mo_mt_call_osmux.py: using BVCI 37366 00:44:47.716819 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:47.727941 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:47.738908 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:47.749878 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:47.760742 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:44:47.771746 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:44:47.885652 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:44:48.007766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:44:48.507298 run create_hlr_db(pid=20207): Launched 00:44:48.631453 bus /sierra_2: Setting Powered False 00:44:49.694723 run create_hlr_db(pid=20207): Terminated: ok {rc=0} 00:44:50.128061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20209): Launched 00:44:50.431215 run osmo-hlr_10.42.42.2(pid=20210): Launched 00:44:50.545081 run osmo-stp_10.42.42.5: Starting osmo-stp 00:44:51.066278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20212): Launched 00:44:51.368356 run osmo-stp_10.42.42.5(pid=20213): Launched 00:44:51.482377 run osmo-msc_10.42.42.6: Starting osmo-msc 00:44:52.026722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20215): Launched 00:44:52.329340 run osmo-msc_10.42.42.6(pid=20216): Launched 00:44:52.496100 run osmo-stp_10.42.42.5(pid=20213): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20213)] 00:44:52.623033 run osmo-stp_10.42.42.5(pid=20213): stdout: | (launched: 2022-12-14_00:44:51.311633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:52.750132 run osmo-stp_10.42.42.5(pid=20213): stderr: | [0;m[38;5;43m20221214004451480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004451480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004451480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004451481 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004451481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004451481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004451481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:52.875190 run osmo-stp_10.42.42.5(pid=20213): stdout: | (launched: 2022-12-14_00:44:51.311633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:44:52.994464 run osmo-stp_10.42.42.5(pid=20213): stderr: | [0;m[38;5;43m20221214004451480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004451480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004451480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004451481 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004451481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004451481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004451481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:44:53.138740 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20213): Process ended prematurely: osmo-stp_10.42.42.5(pid=20213) [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20213)] [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 00:44:53.147579 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 00:44:53.173516 run osmo-hlr_10.42.42.2(pid=20210): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20210)] 00:44:53.220638 run osmo-hlr_10.42.42.2(pid=20210): stdout: | (launched: 2022-12-14_00:44:50.374411) 00:44:53.269166 run osmo-hlr_10.42.42.2(pid=20210): stderr: | [0;m[1;31m20221214004450546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004450546 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004450547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004450547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004450547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004450547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004450559 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004450567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004450567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004450567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:44:53.336395 run osmo-msc_10.42.42.6(pid=20216): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20216)] 00:44:53.383066 run osmo-msc_10.42.42.6(pid=20216): stdout: | (launched: 2022-12-14_00:44:52.272275) 00:44:53.431518 run osmo-msc_10.42.42.6(pid=20216): stderr: | [0;m[38;5;43m20221214004452542 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214004452542 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3812738c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214004452542 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214004452542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214004452543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214004452543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214004452544 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214004452545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214004452545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214004452545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:44:53.480217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20209): Terminating (SIGTERM) 00:44:53.519268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20212): Terminating (SIGTERM) 00:44:53.558208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20215): Terminating (SIGTERM) 00:44:53.597495 --- ParallelTerminationStrategy: PID 20209 died... 00:44:53.616404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20209): Terminated: ok {rc=0} 00:44:53.659610 --- ParallelTerminationStrategy: PID 20212 died... 00:44:53.678225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20212): Terminated: ok {rc=0} 00:44:53.721183 --- ParallelTerminationStrategy: PID 20215 died... 00:44:53.739357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20215): Terminated: ok {rc=0} 00:44:53.823470 bus /sierra_3: Setting Powered False 00:44:54.920439 bus /sierra_3: Setting Powered False 00:44:56.033991 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:44:57.270934 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:44:57.277229 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:44:57.297657 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 00:44:57.324178 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:44:57.374646 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:44:57.395247 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 00:44:57.421253 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:44:57.973841 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 00:44:58.028420 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:44:58.040515 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:44:58.098561 tst mo_mt_call.py: using LAC 37366 00:44:58.225892 tst mo_mt_call.py: using RAC 136 00:44:58.352480 tst mo_mt_call.py: using CellId 37366 00:44:58.470274 tst mo_mt_call.py: using BVCI 37367 00:44:58.579027 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:44:58.590321 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:44:58.601344 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:44:58.612344 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:44:58.623170 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:44:58.634105 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:44:58.753729 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:44:58.870948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:44:59.341332 run create_hlr_db(pid=20221): Launched 00:44:59.464285 bus /sierra_2: Setting Powered False 00:45:00.525165 run create_hlr_db(pid=20221): Terminated: ok {rc=0} 00:45:01.018198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20223): Launched 00:45:01.345416 run osmo-hlr_10.42.42.2(pid=20224): Launched 00:45:01.535029 run osmo-stp_10.42.42.5: Starting osmo-stp 00:45:02.247611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20229): Launched 00:45:02.562870 run osmo-stp_10.42.42.5(pid=20230): Launched 00:45:02.676927 run osmo-msc_10.42.42.6: Starting osmo-msc 00:45:03.223358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20232): Launched 00:45:03.527142 run osmo-msc_10.42.42.6(pid=20233): Launched 00:45:03.693956 run osmo-stp_10.42.42.5(pid=20230): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20230)] 00:45:03.820399 run osmo-stp_10.42.42.5(pid=20230): stdout: | (launched: 2022-12-14_00:45:02.505406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:03.947759 run osmo-stp_10.42.42.5(pid=20230): stderr: | [0;m[38;5;43m20221214004502675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004502675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004502676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004502676 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004502677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004502677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004502677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:04.073558 run osmo-stp_10.42.42.5(pid=20230): stdout: | (launched: 2022-12-14_00:45:02.505406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:04.193637 run osmo-stp_10.42.42.5(pid=20230): stderr: | [0;m[38;5;43m20221214004502675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004502675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004502676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004502676 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004502677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004502677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004502677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:04.336894 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20230): Process ended prematurely: osmo-stp_10.42.42.5(pid=20230) [trial-2397↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20230)] [trial-2397↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 00:45:04.346059 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 00:45:04.372042 run osmo-hlr_10.42.42.2(pid=20224): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20224)] 00:45:04.419455 run osmo-hlr_10.42.42.2(pid=20224): stdout: | (launched: 2022-12-14_00:45:01.284029) 00:45:04.468397 run osmo-hlr_10.42.42.2(pid=20224): stderr: | [0;m[1;31m20221214004501632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004501632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004501632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004501632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004501632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004501632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004501655 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004501678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004501678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004501678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:45:04.536493 run osmo-msc_10.42.42.6(pid=20233): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20233)] 00:45:04.583638 run osmo-msc_10.42.42.6(pid=20233): stdout: | (launched: 2022-12-14_00:45:03.469768) 00:45:04.632291 run osmo-msc_10.42.42.6(pid=20233): stderr: | [0;m[38;5;43m20221214004503742 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214004503742 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcaf432ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214004503742 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214004503742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214004503742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214004503743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214004503744 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214004503745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214004503745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214004503745 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:45:04.681335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20223): Terminating (SIGTERM) 00:45:04.720822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20229): Terminating (SIGTERM) 00:45:04.760065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20232): Terminating (SIGTERM) 00:45:04.799716 --- ParallelTerminationStrategy: PID 20223 died... 00:45:04.818984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20223): Terminated: ok {rc=0} 00:45:04.862845 --- ParallelTerminationStrategy: PID 20229 died... 00:45:04.881641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20229): Terminated: ok {rc=0} 00:45:04.925503 --- ParallelTerminationStrategy: PID 20232 died... 00:45:04.944132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20232): Terminated: ok {rc=0} 00:45:05.029159 bus /sierra_3: Setting Powered False 00:45:06.127017 bus /sierra_3: Setting Powered False 00:45:07.240153 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 00:45:08.382042 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:45:08.394051 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:45:08.451311 tst mo_mt_call_osmux.py: using LAC 37367 00:45:08.572406 tst mo_mt_call_osmux.py: using RAC 137 00:45:08.692812 tst mo_mt_call_osmux.py: using CellId 37367 00:45:08.812636 tst mo_mt_call_osmux.py: using BVCI 37368 00:45:08.923049 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:45:08.934225 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:45:08.945045 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:45:08.955816 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:45:08.966880 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:45:08.977971 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:45:09.093131 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:45:09.214430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:45:09.683068 run create_hlr_db(pid=20235): Launched 00:45:09.806747 bus /sierra_2: Setting Powered False 00:45:10.866915 run create_hlr_db(pid=20235): Terminated: ok {rc=0} 00:45:11.312176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20237): Launched 00:45:11.639184 run osmo-hlr_10.42.42.2(pid=20238): Launched 00:45:11.763369 run osmo-stp_10.42.42.5: Starting osmo-stp 00:45:12.326081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20240): Launched 00:45:12.651914 run osmo-stp_10.42.42.5(pid=20241): Launched 00:45:12.775093 run osmo-msc_10.42.42.6: Starting osmo-msc 00:45:13.362749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20243): Launched 00:45:13.689070 run osmo-msc_10.42.42.6(pid=20244): Launched 00:45:13.868916 run osmo-stp_10.42.42.5(pid=20241): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20241)] 00:45:14.005417 run osmo-stp_10.42.42.5(pid=20241): stdout: | (launched: 2022-12-14_00:45:12.591044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:14.143172 run osmo-stp_10.42.42.5(pid=20241): stderr: | [0;m[38;5;43m20221214004512779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004512779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004512780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004512780 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004512781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004512781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004512781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:14.280412 run osmo-stp_10.42.42.5(pid=20241): stdout: | (launched: 2022-12-14_00:45:12.591044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:14.409774 run osmo-stp_10.42.42.5(pid=20241): stderr: | [0;m[38;5;43m20221214004512779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004512779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004512780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004512780 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004512781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004512781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004512781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:14.564196 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20241): Process ended prematurely: osmo-stp_10.42.42.5(pid=20241) [trial-2397↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20241)] [trial-2397↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 00:45:14.574057 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:45:14.601836 run osmo-hlr_10.42.42.2(pid=20238): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20238)] 00:45:14.652213 run osmo-hlr_10.42.42.2(pid=20238): stdout: | (launched: 2022-12-14_00:45:11.578370) 00:45:14.704420 run osmo-hlr_10.42.42.2(pid=20238): stderr: | [0;m[1;31m20221214004511772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004511772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004511772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004511772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004511772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004511772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004511785 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004511794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004511794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004511794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:45:14.777414 run osmo-msc_10.42.42.6(pid=20244): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20244)] 00:45:14.827082 run osmo-msc_10.42.42.6(pid=20244): stdout: | (launched: 2022-12-14_00:45:13.627896) 00:45:14.878693 run osmo-msc_10.42.42.6(pid=20244): stderr: | [0;m[38;5;43m20221214004513947 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214004513947 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbf1b7c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214004513947 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214004513947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214004513947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214004513947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214004513949 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214004513950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214004513950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214004513950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:45:14.934993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20237): Terminating (SIGTERM) 00:45:14.977888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20240): Terminating (SIGTERM) 00:45:15.031275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20243): Terminating (SIGTERM) 00:45:15.079068 --- ParallelTerminationStrategy: PID 20237 died... 00:45:15.101109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20237): Terminated: ok {rc=0} 00:45:15.152436 --- ParallelTerminationStrategy: PID 20240 died... 00:45:15.172473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20240): Terminated: ok {rc=0} 00:45:15.218838 --- ParallelTerminationStrategy: PID 20243 died... 00:45:15.239219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20243): Terminated: ok {rc=0} 00:45:15.327251 bus /sierra_3: Setting Powered False 00:45:16.431362 bus /sierra_3: Setting Powered False 00:45:17.563311 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:45:18.793634 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:45:18.799146 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:45:18.819451 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 00:45:18.845906 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 00:45:18.896403 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:45:18.916789 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 00:45:18.942779 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 00:45:19.492318 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 00:45:19.541079 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:19.551946 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:45:19.608068 tst mo_mt_call.py: using LAC 37368 00:45:19.723922 tst mo_mt_call.py: using RAC 138 00:45:19.839820 tst mo_mt_call.py: using CellId 37368 00:45:19.954940 tst mo_mt_call.py: using BVCI 37369 00:45:20.062302 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:20.073226 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:20.083709 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:20.094846 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:20.105602 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:20.116630 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:45:20.236647 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:45:20.354445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:45:20.818493 run create_hlr_db(pid=20250): Launched 00:45:20.940682 bus /sierra_2: Setting Powered False 00:45:22.000322 run create_hlr_db(pid=20250): Terminated: ok {rc=0} 00:45:22.417742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20252): Launched 00:45:22.716584 run osmo-hlr_10.42.42.2(pid=20253): Launched 00:45:22.829533 run osmo-stp_10.42.42.5: Starting osmo-stp 00:45:23.349184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20255): Launched 00:45:23.648776 run osmo-stp_10.42.42.5(pid=20256): Launched 00:45:23.762795 run osmo-msc_10.42.42.6: Starting osmo-msc 00:45:24.304750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20258): Launched 00:45:24.605185 run osmo-msc_10.42.42.6(pid=20259): Launched 00:45:24.771875 run osmo-stp_10.42.42.5(pid=20256): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20256)] 00:45:24.898283 run osmo-stp_10.42.42.5(pid=20256): stdout: | (launched: 2022-12-14_00:45:23.594060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:25.024644 run osmo-stp_10.42.42.5(pid=20256): stderr: | [0;m[38;5;43m20221214004523760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004523760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004523760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004523761 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004523761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004523761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004523762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:25.149450 run osmo-stp_10.42.42.5(pid=20256): stdout: | (launched: 2022-12-14_00:45:23.594060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:25.271210 run osmo-stp_10.42.42.5(pid=20256): stderr: | [0;m[38;5;43m20221214004523760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004523760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004523760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004523761 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004523761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004523761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004523762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:25.413941 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20256): Process ended prematurely: osmo-stp_10.42.42.5(pid=20256) [trial-2397↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20256)] [trial-2397↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 00:45:25.422920 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 00:45:25.448871 run osmo-hlr_10.42.42.2(pid=20253): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20253)] 00:45:25.495726 run osmo-hlr_10.42.42.2(pid=20253): stdout: | (launched: 2022-12-14_00:45:22.661882) 00:45:25.544297 run osmo-hlr_10.42.42.2(pid=20253): stderr: | [0;m[1;31m20221214004522835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004522835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004522835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004522835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004522835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004522835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004522847 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004522858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004522858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004522858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:45:25.612111 run osmo-msc_10.42.42.6(pid=20259): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20259)] 00:45:25.659493 run osmo-msc_10.42.42.6(pid=20259): stdout: | (launched: 2022-12-14_00:45:24.550169) 00:45:25.708122 run osmo-msc_10.42.42.6(pid=20259): stderr: | [0;m[38;5;43m20221214004524819 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214004524819 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fee53252c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214004524819 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214004524820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214004524820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214004524820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214004524822 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214004524822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214004524822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214004524822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:45:25.756839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20252): Terminating (SIGTERM) 00:45:25.795975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20255): Terminating (SIGTERM) 00:45:25.835047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20258): Terminating (SIGTERM) 00:45:25.874234 --- ParallelTerminationStrategy: PID 20252 died... 00:45:25.893153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20252): Terminated: ok {rc=0} 00:45:25.936422 --- ParallelTerminationStrategy: PID 20255 died... 00:45:25.954869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20255): Terminated: ok {rc=0} 00:45:25.998518 --- ParallelTerminationStrategy: PID 20258 died... 00:45:26.017060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20258): Terminated: ok {rc=0} 00:45:26.103206 bus /sierra_3: Setting Powered False 00:45:27.202398 bus /sierra_3: Setting Powered False 00:45:28.319392 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 00:45:29.465948 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:29.478010 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:45:29.536078 tst mo_mt_call_osmux.py: using LAC 37369 00:45:29.661835 tst mo_mt_call_osmux.py: using RAC 139 00:45:29.779406 tst mo_mt_call_osmux.py: using CellId 37369 00:45:29.897230 tst mo_mt_call_osmux.py: using BVCI 37370 00:45:30.004642 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:30.015722 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:30.026587 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:30.037362 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:30.047900 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:45:30.058788 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:45:30.178375 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:45:30.296889 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:45:30.795218 run create_hlr_db(pid=20261): Launched 00:45:30.928290 bus /sierra_2: Setting Powered False 00:45:31.991546 run create_hlr_db(pid=20261): Terminated: ok {rc=0} 00:45:32.454513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20263): Launched 00:45:32.777601 run osmo-hlr_10.42.42.2(pid=20264): Launched 00:45:32.902246 run osmo-stp_10.42.42.5: Starting osmo-stp 00:45:33.456830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20266): Launched 00:45:33.779548 run osmo-stp_10.42.42.5(pid=20267): Launched 00:45:33.901689 run osmo-msc_10.42.42.6: Starting osmo-msc 00:45:34.482988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20269): Launched 00:45:34.805692 run osmo-msc_10.42.42.6(pid=20270): Launched 00:45:34.986280 run osmo-stp_10.42.42.5(pid=20267): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20267)] 00:45:35.123807 run osmo-stp_10.42.42.5(pid=20267): stdout: | (launched: 2022-12-14_00:45:33.720472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:35.261793 run osmo-stp_10.42.42.5(pid=20267): stderr: | [0;m[38;5;43m20221214004533907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004533907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004533908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004533908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004533909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004533909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004533909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:35.398119 run osmo-stp_10.42.42.5(pid=20267): stdout: | (launched: 2022-12-14_00:45:33.720472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:35.527315 run osmo-stp_10.42.42.5(pid=20267): stderr: | [0;m[38;5;43m20221214004533907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004533907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004533908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004533908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004533909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004533909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004533909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:35.682622 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20267): Process ended prematurely: osmo-stp_10.42.42.5(pid=20267) [trial-2397↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20267)] [trial-2397↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 00:45:35.692373 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 00:45:35.719926 run osmo-hlr_10.42.42.2(pid=20264): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20264)] 00:45:35.769998 run osmo-hlr_10.42.42.2(pid=20264): stdout: | (launched: 2022-12-14_00:45:32.719364) 00:45:35.821303 run osmo-hlr_10.42.42.2(pid=20264): stderr: | [0;m[1;31m20221214004532912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004532912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004532912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004532912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004532912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004532912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004532925 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004532933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004532934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004532934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:45:35.892817 run osmo-msc_10.42.42.6(pid=20270): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20270)] 00:45:35.941866 run osmo-msc_10.42.42.6(pid=20270): stdout: | (launched: 2022-12-14_00:45:34.746313) 00:45:35.993092 run osmo-msc_10.42.42.6(pid=20270): stderr: | [0;m[38;5;43m20221214004535064 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214004535064 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faff2a18c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214004535065 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214004535065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214004535065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214004535065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214004535067 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214004535067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214004535067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214004535067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:45:36.044557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20263): Terminating (SIGTERM) 00:45:36.086476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20266): Terminating (SIGTERM) 00:45:36.127902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20269): Terminating (SIGTERM) 00:45:36.169728 --- ParallelTerminationStrategy: PID 20263 died... 00:45:36.189772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20263): Terminated: ok {rc=0} 00:45:36.235775 --- ParallelTerminationStrategy: PID 20266 died... 00:45:36.255451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20266): Terminated: ok {rc=0} 00:45:36.301689 --- ParallelTerminationStrategy: PID 20269 died... 00:45:36.321505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20269): Terminated: ok {rc=0} 00:45:36.409842 bus /sierra_3: Setting Powered False 00:45:37.508311 bus /sierra_3: Setting Powered False 00:45:38.624174 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 emergency:sysmo --------------------------------------------------------------------- 00:45:39.858496 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:45:39.863051 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 00:45:39.884303 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 00:45:39.912319 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 00:45:40.003012 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 00:45:40.024585 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 00:45:40.052291 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 00:45:40.628914 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2397 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 00:45:40.635028 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:40.646494 tst emergency:sysmo: Using 1 x bts (candidates: 1) 00:45:40.683582 tst emergency_mo_mt_call.py: using LAC 37370 00:45:40.810637 tst emergency_mo_mt_call.py: using RAC 140 00:45:40.934773 tst emergency_mo_mt_call.py: using CellId 37370 00:45:41.058283 tst emergency_mo_mt_call.py: using BVCI 37371 00:45:41.173683 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:41.184698 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:41.195749 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:41.206648 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:41.217881 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:41.229099 tst emergency:sysmo: Using 1 x modem (candidates: 4) 00:45:41.346274 tst emergency:sysmo: Using 1 x modem (candidates: 4) 00:45:41.461384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:45:41.920799 run create_hlr_db(pid=20277): Launched 00:45:42.042058 bus /sierra_2: Setting Powered False 00:45:43.101268 run create_hlr_db(pid=20277): Terminated: ok {rc=0} 00:45:43.537513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20279): Launched 00:45:43.858816 run osmo-hlr_10.42.42.2(pid=20280): Launched 00:45:43.981289 run osmo-stp_10.42.42.5: Starting osmo-stp 00:45:44.529273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20282): Launched 00:45:44.847306 run osmo-stp_10.42.42.5(pid=20283): Launched 00:45:44.982627 tst emergency_mo_mt_call.py: using MSISDN 8420 00:45:45.146144 run osmo-msc_10.42.42.6: Starting osmo-msc 00:45:45.718434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20285): Launched 00:45:46.048581 run osmo-msc_10.42.42.6(pid=20286): Launched 00:45:46.652857 run osmo-stp_10.42.42.5(pid=20283): ERR: Terminated: ERROR {rc=1} [trial-2397↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20283)] 00:45:46.918059 run osmo-stp_10.42.42.5(pid=20283): stdout: | (launched: 2022-12-14_00:45:44.788840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:47.045670 run osmo-stp_10.42.42.5(pid=20283): stderr: | [0;m[38;5;43m20221214004544976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004544976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004544976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004544977 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004544977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004544977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004544977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:47.172219 run osmo-stp_10.42.42.5(pid=20283): stdout: | (launched: 2022-12-14_00:45:44.788840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:47.294320 run osmo-stp_10.42.42.5(pid=20283): stderr: | [0;m[38;5;43m20221214004544976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004544976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004544976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004544977 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004544977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004544977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004544977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:47.437715 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=20283): Process ended prematurely: osmo-stp_10.42.42.5(pid=20283) [trial-2397↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20283)] [trial-2397↪emergency:sysmo↪emergency_mo_mt_call.py:19] 00:45:47.446143 tst emergency_mo_mt_call.py:19: Test FAILED (6.8 sec) 00:45:47.473024 run osmo-hlr_10.42.42.2(pid=20280): ERR: Terminated: ERROR {rc=237} [trial-2397↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20280)] 00:45:47.522067 run osmo-hlr_10.42.42.2(pid=20280): stdout: | (launched: 2022-12-14_00:45:43.800579) 00:45:47.572199 run osmo-hlr_10.42.42.2(pid=20280): stderr: | [0;m[1;31m20221214004543992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004543993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004543993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004543993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004543993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004543993 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004544006 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004544015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004544015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004544015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:45:47.642317 run osmo-msc_10.42.42.6(pid=20286): ERR: Terminated: ERROR {rc=2} [trial-2397↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20286)] 00:45:47.690418 run osmo-msc_10.42.42.6(pid=20286): stdout: | (launched: 2022-12-14_00:45:45.986303) 00:45:47.740390 run osmo-msc_10.42.42.6(pid=20286): stderr: | [0;m[38;5;43m20221214004546532 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214004546532 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f36e4a39c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214004546533 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214004546533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214004546534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214004546535 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214004546540 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214004546540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214004546541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214004546542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:45:47.790614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20279): Terminating (SIGTERM) 00:45:47.831031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20282): Terminating (SIGTERM) 00:45:47.871524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20285): Terminating (SIGTERM) 00:45:47.912052 --- ParallelTerminationStrategy: PID 20279 died... 00:45:47.931349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20279): Terminated: ok {rc=0} 00:45:47.976087 --- ParallelTerminationStrategy: PID 20282 died... 00:45:47.995396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20282): Terminated: ok {rc=0} 00:45:48.040161 --- ParallelTerminationStrategy: PID 20285 died... 00:45:48.059636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20285): Terminated: ok {rc=0} 00:45:48.147174 bus /sierra_3: Setting Powered False 00:45:49.245984 bus /sierra_3: Setting Powered False 00:45:50.360284 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 00:45:51.447710 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:51.459027 tst emergency:sysmo: Using 1 x bts (candidates: 1) 00:45:51.495598 tst emergency_preemptive_call.py: using LAC 37371 00:45:51.624569 tst emergency_preemptive_call.py: using RAC 141 00:45:51.749809 tst emergency_preemptive_call.py: using CellId 37371 00:45:51.876806 tst emergency_preemptive_call.py: using BVCI 37372 00:45:51.994401 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:52.005606 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:52.016432 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:52.027303 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:52.038560 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 00:45:52.049813 tst emergency:sysmo: Using 1 x modem (candidates: 4) 00:45:52.166688 tst emergency:sysmo: Using 1 x modem (candidates: 4) 00:45:52.285645 tst emergency:sysmo: Using 1 x modem (candidates: 4) 00:45:52.400521 tst emergency:sysmo: Using 1 x modem (candidates: 4) 00:45:52.516653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:45:53.007835 run create_hlr_db(pid=20292): Launched 00:45:53.129413 bus /sierra_2: Setting Powered False 00:45:54.191632 run create_hlr_db(pid=20292): Terminated: ok {rc=0} 00:45:54.634578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20294): Launched 00:45:54.955526 run osmo-hlr_10.42.42.2(pid=20295): Launched 00:45:55.078265 run osmo-stp_10.42.42.5: Starting osmo-stp 00:45:55.624625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20297): Launched 00:45:55.942156 run osmo-stp_10.42.42.5(pid=20298): Launched 00:45:56.073152 tst emergency_preemptive_call.py: using MSISDN 8421 00:45:56.239274 run osmo-msc_10.42.42.6: Starting osmo-msc 00:45:56.809456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20300): Launched 00:45:57.128729 run osmo-msc_10.42.42.6(pid=20301): Launched 00:45:57.312614 run osmo-stp_10.42.42.5(pid=20298): ERR: Terminated: ERROR {rc=1} [trial-2397↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20298)] 00:45:57.445639 run osmo-stp_10.42.42.5(pid=20298): stdout: | (launched: 2022-12-14_00:45:55.884056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:57.580430 run osmo-stp_10.42.42.5(pid=20298): stderr: | [0;m[38;5;43m20221214004556073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004556073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004556073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004556074 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004556074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004556074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004556074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:57.713188 run osmo-stp_10.42.42.5(pid=20298): stdout: | (launched: 2022-12-14_00:45:55.884056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:45:57.839719 run osmo-stp_10.42.42.5(pid=20298): stderr: | [0;m[38;5;43m20221214004556073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004556073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004556073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004556074 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004556074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004556074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004556074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:45:57.991123 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=20298): Process ended prematurely: osmo-stp_10.42.42.5(pid=20298) [trial-2397↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20298)] [trial-2397↪emergency:sysmo↪emergency_preemptive_call.py:32] 00:45:57.999971 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 00:45:58.027028 run osmo-hlr_10.42.42.2(pid=20295): ERR: Terminated: ERROR {rc=237} [trial-2397↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20295)] 00:45:58.077414 run osmo-hlr_10.42.42.2(pid=20295): stdout: | (launched: 2022-12-14_00:45:54.897235) 00:45:58.128777 run osmo-hlr_10.42.42.2(pid=20295): stderr: | [0;m[1;31m20221214004555090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004555090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004555090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004555090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004555091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004555091 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004555105 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004555113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004555114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004555114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:45:58.200436 run osmo-msc_10.42.42.6(pid=20301): ERR: Terminated: ERROR {rc=2} [trial-2397↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20301)] 00:45:58.249727 run osmo-msc_10.42.42.6(pid=20301): stdout: | (launched: 2022-12-14_00:45:57.070138) 00:45:58.300758 run osmo-msc_10.42.42.6(pid=20301): stderr: | [0;m[38;5;43m20221214004557389 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214004557389 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f24b69b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214004557389 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214004557389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214004557389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214004557390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214004557391 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214004557392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214004557392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214004557392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:45:58.352204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20294): Terminating (SIGTERM) 00:45:58.393694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20297): Terminating (SIGTERM) 00:45:58.434997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20300): Terminating (SIGTERM) 00:45:58.476430 --- ParallelTerminationStrategy: PID 20294 died... 00:45:58.496519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20294): Terminated: ok {rc=0} 00:45:58.542383 --- ParallelTerminationStrategy: PID 20297 died... 00:45:58.562076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20297): Terminated: ok {rc=0} 00:45:58.607678 --- ParallelTerminationStrategy: PID 20300 died... 00:45:58.627278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20300): Terminated: ok {rc=0} 00:45:58.714421 bus /sierra_9: Setting Powered False 00:45:59.809018 bus /sierra_9: Setting Powered False 00:46:00.939360 bus /sierra_8: Setting Powered False 00:46:02.051965 bus /sierra_8: Setting Powered False 00:46:03.187033 bus /sierra_3: Setting Powered False 00:46:04.284458 bus /sierra_3: Setting Powered False 00:46:05.401292 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:sysmo --------------------------------------------------------------------- 00:46:06.657296 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:46:06.661442 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 00:46:06.682359 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 00:46:06.720384 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 00:46:06.806879 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 00:46:06.827331 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 00:46:06.865081 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 00:46:07.453667 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 00:46:07.503880 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:07.514406 tst gprs:sysmo: Using 1 x bts (candidates: 1) 00:46:07.549230 tst cs_paging_gprs_active.py: using LAC 37372 00:46:07.669787 tst cs_paging_gprs_active.py: using RAC 142 00:46:07.798455 tst cs_paging_gprs_active.py: using CellId 37372 00:46:07.916348 tst cs_paging_gprs_active.py: using BVCI 37373 00:46:08.025580 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:08.035997 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:08.046599 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:08.057092 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:08.067318 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:08.077806 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:08.088149 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:08.098433 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:08.108937 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:08.224188 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:08.344361 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:46:08.564409 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:08.892654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20306): Launched 00:46:09.176325 run iperf3-srv_10.42.42.10(pid=20307): Launched 00:46:09.298590 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:46:09.518032 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:09.843819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20308): Launched 00:46:10.126754 run iperf3-srv_10.42.42.10(pid=20309): Launched 00:46:10.248498 tst cs_paging_gprs_active.py:38: start network... 00:46:10.468162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:46:10.970222 run create_hlr_db(pid=20310): Launched 00:46:11.096662 bus /sierra_2: Setting Powered False 00:46:12.160864 run create_hlr_db(pid=20310): Terminated: ok {rc=0} 00:46:12.592409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20312): Launched 00:46:12.894112 run osmo-hlr_10.42.42.2(pid=20313): Launched 00:46:13.009137 run osmo-stp_10.42.42.5: Starting osmo-stp 00:46:13.525076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20315): Launched 00:46:13.827533 run osmo-stp_10.42.42.5(pid=20316): Launched 00:46:13.942630 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:46:15.443745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20318): Launched 00:46:15.560048 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:46:15.816348 run patchelf(pid=20319): Launched 00:46:16.029613 run osmo-stp_10.42.42.5(pid=20316): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20316)] 00:46:16.164612 run osmo-stp_10.42.42.5(pid=20316): stdout: | (launched: 2022-12-14_00:46:13.771267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:16.297219 run osmo-stp_10.42.42.5(pid=20316): stderr: | [0;m[38;5;43m20221214004613937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004613937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004613937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004613937 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004613938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004613938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004613938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:16.429766 run osmo-stp_10.42.42.5(pid=20316): stdout: | (launched: 2022-12-14_00:46:13.771267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:16.554877 run osmo-stp_10.42.42.5(pid=20316): stderr: | [0;m[38;5;43m20221214004613937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004613937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004613937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004613937 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004613938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004613938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004613938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:16.704817 run patchelf(pid=20319): Terminating (SIGINT) 00:46:16.879270 run patchelf(pid=20319): Terminated: ok {rc=0} 00:46:17.003592 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20316): Process ended prematurely: osmo-stp_10.42.42.5(pid=20316) [trial-2397↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20316)] [trial-2397↪gprs:sysmo↪cs_paging_gprs_active.py:38] 00:46:17.013719 tst cs_paging_gprs_active.py:38: Test FAILED (9.5 sec) 00:46:17.042379 run osmo-hlr_10.42.42.2(pid=20313): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20313)] 00:46:17.090299 run osmo-hlr_10.42.42.2(pid=20313): stdout: | (launched: 2022-12-14_00:46:12.838715) 00:46:17.139865 run osmo-hlr_10.42.42.2(pid=20313): stderr: | [0;m[1;31m20221214004613010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004613010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004613010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004613010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004613010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004613010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004613030 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004613040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004613040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004613041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:46:17.189533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20306): Terminating (SIGTERM) 00:46:17.230331 run iperf3-srv_10.42.42.10(pid=20307): Terminating (SIGTERM) 00:46:17.269119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20308): Terminating (SIGTERM) 00:46:17.308008 run iperf3-srv_10.42.42.10(pid=20309): Terminating (SIGTERM) 00:46:17.346875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20312): Terminating (SIGTERM) 00:46:17.385916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20315): Terminating (SIGTERM) 00:46:17.424818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20318): Terminating (SIGTERM) 00:46:17.463943 --- ParallelTerminationStrategy: PID 20306 died... 00:46:17.482808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20306): Terminated: ok {rc=0} 00:46:17.525902 --- ParallelTerminationStrategy: PID 20307 died... 00:46:17.544117 run iperf3-srv_10.42.42.10(pid=20307): Terminated {rc=256} 00:46:17.587012 --- ParallelTerminationStrategy: PID 20308 died... 00:46:17.605348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20308): Terminated: ok {rc=0} 00:46:17.648266 --- ParallelTerminationStrategy: PID 20309 died... 00:46:17.666646 run iperf3-srv_10.42.42.10(pid=20309): Terminated {rc=256} 00:46:17.709894 --- ParallelTerminationStrategy: PID 20312 died... 00:46:17.728514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20312): Terminated: ok {rc=0} 00:46:17.772132 --- ParallelTerminationStrategy: PID 20315 died... 00:46:17.790549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20315): Terminated: ok {rc=0} 00:46:17.833646 --- ParallelTerminationStrategy: PID 20318 died... 00:46:17.851910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20318): Terminated: ok {rc=0} 00:46:17.936285 bus /gobi_0: Setting Powered False 00:46:19.034592 bus /gobi_0: Setting Powered False 00:46:20.147568 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:sysmo iperf3.py ---------------------------------------------- 00:46:21.293588 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:21.304676 tst gprs:sysmo: Using 1 x bts (candidates: 1) 00:46:21.341837 tst iperf3.py: using LAC 37373 00:46:21.466217 tst iperf3.py: using RAC 143 00:46:21.583813 tst iperf3.py: using CellId 37373 00:46:21.700156 tst iperf3.py: using BVCI 37374 00:46:21.809251 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:21.819647 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:21.830041 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:21.840347 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:21.850598 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:21.860814 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:21.871181 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:21.893290 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:21.908616 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:22.034021 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:46:22.253775 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:22.579657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20320): Launched 00:46:22.863363 run iperf3-srv_10.42.42.10(pid=20321): Launched 00:46:22.986927 tst iperf3.py:8: start network... 00:46:23.205724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:46:23.706725 run create_hlr_db(pid=20322): Launched 00:46:23.833182 bus /gobi_6: Setting Powered False 00:46:24.897229 run create_hlr_db(pid=20322): Terminated: ok {rc=0} 00:46:25.349297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20324): Launched 00:46:25.673690 run osmo-hlr_10.42.42.2(pid=20325): Launched 00:46:25.799818 run osmo-stp_10.42.42.5: Starting osmo-stp 00:46:26.365120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20327): Launched 00:46:26.690033 run osmo-stp_10.42.42.5(pid=20328): Launched 00:46:26.813606 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:46:27.369844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20330): Launched 00:46:27.495114 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:46:27.770090 run patchelf(pid=20331): Launched 00:46:27.950702 run osmo-stp_10.42.42.5(pid=20328): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20328)] 00:46:28.087976 run osmo-stp_10.42.42.5(pid=20328): stdout: | (launched: 2022-12-14_00:46:26.630496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:28.227535 run osmo-stp_10.42.42.5(pid=20328): stderr: | [0;m[38;5;43m20221214004626819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004626820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004626820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004626820 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004626821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004626821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004626821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:28.366941 run osmo-stp_10.42.42.5(pid=20328): stdout: | (launched: 2022-12-14_00:46:26.630496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:28.499333 run osmo-stp_10.42.42.5(pid=20328): stderr: | [0;m[38;5;43m20221214004626819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004626820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004626820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004626820 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004626821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004626821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004626821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:28.656521 run patchelf(pid=20331): Terminating (SIGINT) 00:46:28.837545 run patchelf(pid=20331): Terminated: ok {rc=0} 00:46:28.968199 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20328): Process ended prematurely: osmo-stp_10.42.42.5(pid=20328) [trial-2397↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20328)] [trial-2397↪gprs:sysmo↪iperf3.py:8] 00:46:28.978458 tst iperf3.py:8: Test FAILED (7.7 sec) 00:46:29.006551 run osmo-hlr_10.42.42.2(pid=20325): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20325)] 00:46:29.056620 run osmo-hlr_10.42.42.2(pid=20325): stdout: | (launched: 2022-12-14_00:46:25.614083) 00:46:29.108645 run osmo-hlr_10.42.42.2(pid=20325): stderr: | [0;m[1;31m20221214004625807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004625807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004625807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004625807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004625807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004625807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004625819 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004625827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004625827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004625828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:46:29.160612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20320): Terminating (SIGTERM) 00:46:29.202252 run iperf3-srv_10.42.42.10(pid=20321): Terminating (SIGTERM) 00:46:29.244347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20324): Terminating (SIGTERM) 00:46:29.286915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20327): Terminating (SIGTERM) 00:46:29.329412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20330): Terminating (SIGTERM) 00:46:29.371707 --- ParallelTerminationStrategy: PID 20320 died... 00:46:29.392289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20320): Terminated: ok {rc=0} 00:46:29.439066 --- ParallelTerminationStrategy: PID 20321 died... 00:46:29.459144 run iperf3-srv_10.42.42.10(pid=20321): Terminated {rc=256} 00:46:29.505296 --- ParallelTerminationStrategy: PID 20324 died... 00:46:29.525240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20324): Terminated: ok {rc=0} 00:46:29.571618 --- ParallelTerminationStrategy: PID 20327 died... 00:46:29.591674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20327): Terminated: ok {rc=0} 00:46:29.638036 --- ParallelTerminationStrategy: PID 20330 died... 00:46:29.658053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20330): Terminated: ok {rc=0} 00:46:29.746627 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:sysmo iperf3m4.py ---------------------------------------------- 00:46:30.922460 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:30.939243 tst gprs:sysmo: Using 1 x bts (candidates: 1) 00:46:30.976761 tst iperf3m4.py: using LAC 37374 00:46:31.109530 tst iperf3m4.py: using RAC 144 00:46:31.269230 tst iperf3m4.py: using CellId 37374 00:46:31.399412 tst iperf3m4.py: using BVCI 37375 00:46:31.549084 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:31.564327 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:31.576524 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:31.588813 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:31.604764 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:31.618435 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:31.630813 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:31.642176 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:31.654336 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:31.805674 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:31.952760 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:32.068553 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:32.208012 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:46:32.440517 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:32.768484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20332): Launched 00:46:33.052130 run iperf3-srv_10.42.42.10(pid=20333): Launched 00:46:33.175410 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:46:33.394709 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:33.725769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20334): Launched 00:46:33.991593 run iperf3-srv_10.42.42.10(pid=20335): Launched 00:46:34.105281 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:46:34.306290 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:34.609319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20336): Launched 00:46:34.872356 run iperf3-srv_10.42.42.10(pid=20337): Launched 00:46:34.985234 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:46:35.185682 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:46:35.487650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20338): Launched 00:46:35.765006 run iperf3-srv_10.42.42.10(pid=20339): Launched 00:46:35.880093 tst iperf3m4.py:8: start network... 00:46:36.081082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:46:36.547602 run create_hlr_db(pid=20340): Launched 00:46:36.673246 bus /gobi_6: Setting Powered False 00:46:37.733767 run create_hlr_db(pid=20340): Terminated: ok {rc=0} 00:46:38.177341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20342): Launched 00:46:38.502364 run osmo-hlr_10.42.42.2(pid=20343): Launched 00:46:38.628106 run osmo-stp_10.42.42.5: Starting osmo-stp 00:46:39.187636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20345): Launched 00:46:39.511934 run osmo-stp_10.42.42.5(pid=20346): Launched 00:46:39.638208 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:46:40.198851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20348): Launched 00:46:40.323958 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:46:40.599064 run patchelf(pid=20349): Launched 00:46:40.781265 run osmo-stp_10.42.42.5(pid=20346): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20346)] 00:46:40.919263 run osmo-stp_10.42.42.5(pid=20346): stdout: | (launched: 2022-12-14_00:46:39.452466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:41.059514 run osmo-stp_10.42.42.5(pid=20346): stderr: | [0;m[38;5;43m20221214004639640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004639640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004639640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004639641 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004639641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004639641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004639641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:41.199797 run osmo-stp_10.42.42.5(pid=20346): stdout: | (launched: 2022-12-14_00:46:39.452466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:41.332755 run osmo-stp_10.42.42.5(pid=20346): stderr: | [0;m[38;5;43m20221214004639640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004639640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004639640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004639641 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004639641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004639641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004639641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:41.490386 run patchelf(pid=20349): Terminating (SIGINT) 00:46:41.672241 run patchelf(pid=20349): Terminated: ok {rc=0} 00:46:41.803945 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20346): Process ended prematurely: osmo-stp_10.42.42.5(pid=20346) [trial-2397↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20346)] [trial-2397↪gprs:sysmo↪iperf3m4.py:8] 00:46:41.814209 tst iperf3m4.py:8: Test FAILED (10.9 sec) 00:46:41.843052 run osmo-hlr_10.42.42.2(pid=20343): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20343)] 00:46:41.894010 run osmo-hlr_10.42.42.2(pid=20343): stdout: | (launched: 2022-12-14_00:46:38.443023) 00:46:41.946934 run osmo-hlr_10.42.42.2(pid=20343): stderr: | [0;m[1;31m20221214004638637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004638637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004638637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004638637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004638637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004638637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004638659 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004638668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004638668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004638668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:46:41.999827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20332): Terminating (SIGTERM) 00:46:42.041750 run iperf3-srv_10.42.42.10(pid=20333): Terminating (SIGTERM) 00:46:42.083976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20334): Terminating (SIGTERM) 00:46:42.127012 run iperf3-srv_10.42.42.10(pid=20335): Terminating (SIGTERM) 00:46:42.169292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20336): Terminating (SIGTERM) 00:46:42.211912 run iperf3-srv_10.42.42.10(pid=20337): Terminating (SIGTERM) 00:46:42.254589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20338): Terminating (SIGTERM) 00:46:42.297311 run iperf3-srv_10.42.42.10(pid=20339): Terminating (SIGTERM) 00:46:42.339239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20342): Terminating (SIGTERM) 00:46:42.381747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20345): Terminating (SIGTERM) 00:46:42.424361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20348): Terminating (SIGTERM) 00:46:42.467236 --- ParallelTerminationStrategy: PID 20332 died... 00:46:42.487592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20332): Terminated: ok {rc=0} 00:46:42.534304 --- ParallelTerminationStrategy: PID 20333 died... 00:46:42.554245 run iperf3-srv_10.42.42.10(pid=20333): Terminated {rc=256} 00:46:42.600570 --- ParallelTerminationStrategy: PID 20334 died... 00:46:42.620586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20334): Terminated: ok {rc=0} 00:46:42.666870 --- ParallelTerminationStrategy: PID 20335 died... 00:46:42.686820 run iperf3-srv_10.42.42.10(pid=20335): Terminated {rc=256} 00:46:42.733304 --- ParallelTerminationStrategy: PID 20336 died... 00:46:42.753271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20336): Terminated: ok {rc=0} 00:46:42.799713 --- ParallelTerminationStrategy: PID 20337 died... 00:46:42.819573 run iperf3-srv_10.42.42.10(pid=20337): Terminated {rc=256} 00:46:42.865709 --- ParallelTerminationStrategy: PID 20338 died... 00:46:42.885677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20338): Terminated: ok {rc=0} 00:46:42.932134 --- ParallelTerminationStrategy: PID 20339 died... 00:46:42.951922 run iperf3-srv_10.42.42.10(pid=20339): Terminated {rc=256} 00:46:42.998070 --- ParallelTerminationStrategy: PID 20342 died... 00:46:43.017987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20342): Terminated: ok {rc=0} 00:46:43.064407 --- ParallelTerminationStrategy: PID 20345 died... 00:46:43.084819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20345): Terminated: ok {rc=0} 00:46:43.131291 --- ParallelTerminationStrategy: PID 20348 died... 00:46:43.151392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20348): Terminated: ok {rc=0} 00:46:43.239273 bus /gobi_4: Setting Powered False 00:46:44.338342 bus /gobi_4: Setting Powered False 00:46:45.454971 bus /gobi_1: Setting Powered False 00:46:46.551933 bus /gobi_1: Setting Powered False 00:46:47.678572 bus /gobi_0: Setting Powered False 00:46:48.777416 bus /gobi_0: Setting Powered False 00:46:49.894290 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:sysmo ping.py ---------------------------------------------- 00:46:50.997844 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:51.009699 tst gprs:sysmo: Using 1 x bts (candidates: 1) 00:46:51.045952 tst ping.py: using LAC 37375 00:46:51.173410 tst ping.py: using RAC 145 00:46:51.298477 tst ping.py: using CellId 37375 00:46:51.423568 tst ping.py: using BVCI 37376 00:46:51.539643 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:51.550762 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:51.561881 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:51.572673 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:51.583760 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:51.594929 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:51.606275 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:51.617507 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:51.735829 tst ping.py:19: start network... 00:46:51.950670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:46:52.444609 run create_hlr_db(pid=20350): Launched 00:46:52.568514 bus /gobi_6: Setting Powered False 00:46:53.632223 run create_hlr_db(pid=20350): Terminated: ok {rc=0} 00:46:54.060071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20352): Launched 00:46:54.358023 run osmo-hlr_10.42.42.2(pid=20353): Launched 00:46:54.470189 run osmo-stp_10.42.42.5: Starting osmo-stp 00:46:54.980530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20355): Launched 00:46:55.277447 run osmo-stp_10.42.42.5(pid=20356): Launched 00:46:55.391156 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:46:55.904053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20358): Launched 00:46:56.018264 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:46:56.268437 run patchelf(pid=20359): Launched 00:46:56.433900 run osmo-stp_10.42.42.5(pid=20356): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20356)] 00:46:56.559544 run osmo-stp_10.42.42.5(pid=20356): stdout: | (launched: 2022-12-14_00:46:55.222248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:56.686928 run osmo-stp_10.42.42.5(pid=20356): stderr: | [0;m[38;5;43m20221214004655389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004655389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004655389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004655390 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004655390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004655390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004655390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:56.814614 run osmo-stp_10.42.42.5(pid=20356): stdout: | (launched: 2022-12-14_00:46:55.222248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:46:56.935607 run osmo-stp_10.42.42.5(pid=20356): stderr: | [0;m[38;5;43m20221214004655389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004655389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004655389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004655390 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004655390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004655390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004655390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:46:57.078506 run patchelf(pid=20359): Terminating (SIGINT) 00:46:57.244434 run patchelf(pid=20359): Terminated: ok {rc=0} 00:46:57.364058 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20356): Process ended prematurely: osmo-stp_10.42.42.5(pid=20356) [trial-2397↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20356)] [trial-2397↪gprs:sysmo↪ping.py:22] 00:46:57.372783 tst ping.py:22: Test FAILED (6.4 sec) 00:46:57.399347 run osmo-hlr_10.42.42.2(pid=20353): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20353)] 00:46:57.447368 run osmo-hlr_10.42.42.2(pid=20353): stdout: | (launched: 2022-12-14_00:46:54.302818) 00:46:57.496206 run osmo-hlr_10.42.42.2(pid=20353): stderr: | [0;m[1;31m20221214004654476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004654476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004654476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004654476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004654476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004654476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004654489 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004654497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004654498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004654498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:46:57.545525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20352): Terminating (SIGTERM) 00:46:57.585159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20355): Terminating (SIGTERM) 00:46:57.624835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20358): Terminating (SIGTERM) 00:46:57.664697 --- ParallelTerminationStrategy: PID 20352 died... 00:46:57.683932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20352): Terminated: ok {rc=0} 00:46:57.727754 --- ParallelTerminationStrategy: PID 20355 died... 00:46:57.746376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20355): Terminated: ok {rc=0} 00:46:57.790032 --- ParallelTerminationStrategy: PID 20358 died... 00:46:57.808734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20358): Terminated: ok {rc=0} 00:46:57.894707 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 00:46:58.983456 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:58.995089 tst gprs:sysmo: Using 1 x bts (candidates: 1) 00:46:59.032346 tst ping_idle_ping.py: using LAC 37376 00:46:59.151993 tst ping_idle_ping.py: using RAC 146 00:46:59.270616 tst ping_idle_ping.py: using CellId 37376 00:46:59.389479 tst ping_idle_ping.py: using BVCI 37377 00:46:59.497161 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:59.507681 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:59.518227 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:59.528601 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:59.538973 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:59.549762 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:59.560625 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 00:46:59.571542 tst gprs:sysmo: Using 1 x modem (candidates: 4) 00:46:59.693949 tst ping_idle_ping.py:24: start network... 00:46:59.892062 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:47:00.352083 run create_hlr_db(pid=20360): Launched 00:47:00.473747 bus /gobi_6: Setting Powered False 00:47:01.540119 run create_hlr_db(pid=20360): Terminated: ok {rc=0} 00:47:01.998683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20362): Launched 00:47:02.334812 run osmo-hlr_10.42.42.2(pid=20363): Launched 00:47:02.460401 run osmo-stp_10.42.42.5: Starting osmo-stp 00:47:03.010659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20365): Launched 00:47:03.332584 run osmo-stp_10.42.42.5(pid=20366): Launched 00:47:03.455257 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:47:04.006701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20368): Launched 00:47:04.130874 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:47:04.401741 run patchelf(pid=20369): Launched 00:47:04.582603 run osmo-stp_10.42.42.5(pid=20366): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20366)] 00:47:04.718745 run osmo-stp_10.42.42.5(pid=20366): stdout: | (launched: 2022-12-14_00:47:03.274090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:04.856460 run osmo-stp_10.42.42.5(pid=20366): stderr: | [0;m[38;5;43m20221214004703462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004703462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004703463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004703463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004703464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004703464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004703464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:04.995028 run osmo-stp_10.42.42.5(pid=20366): stdout: | (launched: 2022-12-14_00:47:03.274090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:05.127061 run osmo-stp_10.42.42.5(pid=20366): stderr: | [0;m[38;5;43m20221214004703462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004703462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004703463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004703463 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004703464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004703464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004703464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:05.283361 run patchelf(pid=20369): Terminating (SIGINT) 00:47:05.463039 run patchelf(pid=20369): Terminated: ok {rc=0} 00:47:05.592577 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20366): Process ended prematurely: osmo-stp_10.42.42.5(pid=20366) [trial-2397↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20366)] [trial-2397↪gprs:sysmo↪ping_idle_ping.py:27] 00:47:05.602040 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 00:47:05.629627 run osmo-hlr_10.42.42.2(pid=20363): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20363)] 00:47:05.679764 run osmo-hlr_10.42.42.2(pid=20363): stdout: | (launched: 2022-12-14_00:47:02.276341) 00:47:05.731149 run osmo-hlr_10.42.42.2(pid=20363): stderr: | [0;m[1;31m20221214004702469 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004702470 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004702470 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004702470 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004702470 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004702470 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004702482 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004702490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004702490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004702490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:47:05.783005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20362): Terminating (SIGTERM) 00:47:05.824401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20365): Terminating (SIGTERM) 00:47:05.865943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20368): Terminating (SIGTERM) 00:47:05.908088 --- ParallelTerminationStrategy: PID 20362 died... 00:47:05.928372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20362): Terminated: ok {rc=0} 00:47:05.974861 --- ParallelTerminationStrategy: PID 20365 died... 00:47:05.994947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20365): Terminated: ok {rc=0} 00:47:06.041284 --- ParallelTerminationStrategy: PID 20368 died... 00:47:06.061331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20368): Terminated: ok {rc=0} 00:47:06.150549 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 00:47:07.431619 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:47:07.437336 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 00:47:07.458581 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 00:47:07.497449 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 00:47:07.582898 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 00:47:07.603362 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 00:47:07.641037 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 00:47:08.234887 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 00:47:08.283337 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:08.294135 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:47:08.330209 tst cs_paging_gprs_active.py: using LAC 37377 00:47:08.461657 tst cs_paging_gprs_active.py: using RAC 147 00:47:08.589960 tst cs_paging_gprs_active.py: using CellId 37377 00:47:08.715881 tst cs_paging_gprs_active.py: using BVCI 37378 00:47:08.835876 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:08.847217 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:08.858263 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:08.869393 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:08.880607 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:08.891882 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:08.903355 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:08.914561 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:08.926121 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:09.043336 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:09.159600 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:47:09.364511 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:09.670132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20373): Launched 00:47:09.938541 run iperf3-srv_10.42.42.10(pid=20374): Launched 00:47:10.054984 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:47:10.260038 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:10.565631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20375): Launched 00:47:10.833279 run iperf3-srv_10.42.42.10(pid=20376): Launched 00:47:10.947985 tst cs_paging_gprs_active.py:38: start network... 00:47:11.151619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:47:11.622513 run create_hlr_db(pid=20377): Launched 00:47:11.749461 bus /gobi_6: Setting Powered False 00:47:12.809745 run create_hlr_db(pid=20377): Terminated: ok {rc=0} 00:47:13.254439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20379): Launched 00:47:13.581722 run osmo-hlr_10.42.42.2(pid=20380): Launched 00:47:13.709585 run osmo-stp_10.42.42.5: Starting osmo-stp 00:47:14.278319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20382): Launched 00:47:14.605823 run osmo-stp_10.42.42.5(pid=20383): Launched 00:47:14.734252 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:47:15.301498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20385): Launched 00:47:15.427270 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:47:15.704111 run patchelf(pid=20386): Launched 00:47:15.898529 run osmo-stp_10.42.42.5(pid=20383): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20383)] 00:47:16.042201 run osmo-stp_10.42.42.5(pid=20383): stdout: | (launched: 2022-12-14_00:47:14.545949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:16.185325 run osmo-stp_10.42.42.5(pid=20383): stderr: | [0;m[38;5;43m20221214004714736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004714736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004714736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004714737 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004714738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004714738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004714738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:16.328412 run osmo-stp_10.42.42.5(pid=20383): stdout: | (launched: 2022-12-14_00:47:14.545949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:16.465642 run osmo-stp_10.42.42.5(pid=20383): stderr: | [0;m[38;5;43m20221214004714736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004714736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004714736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004714737 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004714738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004714738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004714738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:16.627767 run patchelf(pid=20386): Terminating (SIGINT) 00:47:16.815008 run patchelf(pid=20386): Terminated: ok {rc=0} 00:47:16.950141 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20383): Process ended prematurely: osmo-stp_10.42.42.5(pid=20383) [trial-2397↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20383)] [trial-2397↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 00:47:16.961697 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 00:47:16.991486 run osmo-hlr_10.42.42.2(pid=20380): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20380)] 00:47:17.047112 run osmo-hlr_10.42.42.2(pid=20380): stdout: | (launched: 2022-12-14_00:47:13.521992) 00:47:17.101453 run osmo-hlr_10.42.42.2(pid=20380): stderr: | [0;m[1;31m20221214004713716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004713716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004713716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004713716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004713716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004713716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004713729 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004713737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004713737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004713737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:47:17.156276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20373): Terminating (SIGTERM) 00:47:17.199849 run iperf3-srv_10.42.42.10(pid=20374): Terminating (SIGTERM) 00:47:17.246396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20375): Terminating (SIGTERM) 00:47:17.291280 run iperf3-srv_10.42.42.10(pid=20376): Terminating (SIGTERM) 00:47:17.335993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20379): Terminating (SIGTERM) 00:47:17.378758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20382): Terminating (SIGTERM) 00:47:17.421396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20385): Terminating (SIGTERM) 00:47:17.463535 --- ParallelTerminationStrategy: PID 20373 died... 00:47:17.483913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20373): Terminated: ok {rc=0} 00:47:17.530715 --- ParallelTerminationStrategy: PID 20374 died... 00:47:17.550436 run iperf3-srv_10.42.42.10(pid=20374): Terminated {rc=256} 00:47:17.596501 --- ParallelTerminationStrategy: PID 20375 died... 00:47:17.616442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20375): Terminated: ok {rc=0} 00:47:17.662603 --- ParallelTerminationStrategy: PID 20376 died... 00:47:17.682740 run iperf3-srv_10.42.42.10(pid=20376): Terminated {rc=256} 00:47:17.728774 --- ParallelTerminationStrategy: PID 20379 died... 00:47:17.748487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20379): Terminated: ok {rc=0} 00:47:17.794484 --- ParallelTerminationStrategy: PID 20382 died... 00:47:17.814278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20382): Terminated: ok {rc=0} 00:47:17.860522 --- ParallelTerminationStrategy: PID 20385 died... 00:47:17.880453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20385): Terminated: ok {rc=0} 00:47:17.969202 bus /gobi_0: Setting Powered False 00:47:19.067725 bus /gobi_0: Setting Powered False 00:47:20.183468 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 00:47:21.327517 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:21.339026 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:47:21.375892 tst iperf3.py: using LAC 37378 00:47:21.493362 tst iperf3.py: using RAC 148 00:47:21.615115 tst iperf3.py: using CellId 37378 00:47:21.732585 tst iperf3.py: using BVCI 37379 00:47:21.842108 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:21.852778 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:21.863449 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:21.874037 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:21.884710 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:21.895216 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:21.905947 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:21.916920 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:21.928133 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:22.050420 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:47:22.270782 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:22.596537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20387): Launched 00:47:22.881211 run iperf3-srv_10.42.42.10(pid=20388): Launched 00:47:23.003225 tst iperf3.py:8: start network... 00:47:23.222152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:47:23.724499 run create_hlr_db(pid=20389): Launched 00:47:23.851522 bus /gobi_6: Setting Powered False 00:47:24.915149 run create_hlr_db(pid=20389): Terminated: ok {rc=0} 00:47:25.367590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20391): Launched 00:47:25.694269 run osmo-hlr_10.42.42.2(pid=20392): Launched 00:47:25.819752 run osmo-stp_10.42.42.5: Starting osmo-stp 00:47:26.378640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20394): Launched 00:47:26.703790 run osmo-stp_10.42.42.5(pid=20395): Launched 00:47:26.829444 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:47:27.389662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20397): Launched 00:47:27.515505 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:47:27.791489 run patchelf(pid=20399): Launched 00:47:27.973446 run osmo-stp_10.42.42.5(pid=20395): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20395)] 00:47:28.111753 run osmo-stp_10.42.42.5(pid=20395): stdout: | (launched: 2022-12-14_00:47:26.644014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:28.251605 run osmo-stp_10.42.42.5(pid=20395): stderr: | [0;m[38;5;43m20221214004726835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004726835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004726835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004726836 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004726836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004726836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004726836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:28.391866 run osmo-stp_10.42.42.5(pid=20395): stdout: | (launched: 2022-12-14_00:47:26.644014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:28.524370 run osmo-stp_10.42.42.5(pid=20395): stderr: | [0;m[38;5;43m20221214004726835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004726835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004726835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004726836 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004726836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004726836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004726836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:28.681657 run patchelf(pid=20399): Terminating (SIGINT) 00:47:28.862548 run patchelf(pid=20399): Terminated: ok {rc=0} 00:47:28.993441 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20395): Process ended prematurely: osmo-stp_10.42.42.5(pid=20395) [trial-2397↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20395)] [trial-2397↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 00:47:29.003653 tst iperf3.py:8: Test FAILED (7.7 sec) 00:47:29.031847 run osmo-hlr_10.42.42.2(pid=20392): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20392)] 00:47:29.082141 run osmo-hlr_10.42.42.2(pid=20392): stdout: | (launched: 2022-12-14_00:47:25.634717) 00:47:29.133912 run osmo-hlr_10.42.42.2(pid=20392): stderr: | [0;m[1;31m20221214004725831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004725831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004725831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004725831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004725831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004725831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004725843 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004725851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004725852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004725852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:47:29.185866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20387): Terminating (SIGTERM) 00:47:29.227521 run iperf3-srv_10.42.42.10(pid=20388): Terminating (SIGTERM) 00:47:29.268911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20391): Terminating (SIGTERM) 00:47:29.310486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20394): Terminating (SIGTERM) 00:47:29.352357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20397): Terminating (SIGTERM) 00:47:29.394558 --- ParallelTerminationStrategy: PID 20387 died... 00:47:29.414913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20387): Terminated: ok {rc=0} 00:47:29.461229 --- ParallelTerminationStrategy: PID 20388 died... 00:47:29.481163 run iperf3-srv_10.42.42.10(pid=20388): Terminated {rc=256} 00:47:29.527014 --- ParallelTerminationStrategy: PID 20391 died... 00:47:29.546799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20391): Terminated: ok {rc=0} 00:47:29.592597 --- ParallelTerminationStrategy: PID 20394 died... 00:47:29.612449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20394): Terminated: ok {rc=0} 00:47:29.658427 --- ParallelTerminationStrategy: PID 20397 died... 00:47:29.678438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20397): Terminated: ok {rc=0} 00:47:29.766604 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 00:47:30.925102 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:30.937939 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:47:30.976065 tst iperf3m4.py: using LAC 37379 00:47:31.112080 tst iperf3m4.py: using RAC 149 00:47:31.246762 tst iperf3m4.py: using CellId 37379 00:47:31.404067 tst iperf3m4.py: using BVCI 37380 00:47:31.527980 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:31.540045 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:31.551962 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:31.563866 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:31.575694 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:31.589235 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:31.602051 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:31.615615 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:31.628236 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:31.753963 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:31.897244 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:32.019973 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:32.142724 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:47:32.352391 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:32.659669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20400): Launched 00:47:32.924786 run iperf3-srv_10.42.42.10(pid=20401): Launched 00:47:33.038717 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:47:33.240265 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:33.544547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20402): Launched 00:47:33.808618 run iperf3-srv_10.42.42.10(pid=20403): Launched 00:47:33.921952 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:47:34.123231 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:34.428689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20404): Launched 00:47:34.693184 run iperf3-srv_10.42.42.10(pid=20405): Launched 00:47:34.806458 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:47:35.008179 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:47:35.313458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20406): Launched 00:47:35.579060 run iperf3-srv_10.42.42.10(pid=20407): Launched 00:47:35.692292 tst iperf3m4.py:8: start network... 00:47:35.894238 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:47:36.364738 run create_hlr_db(pid=20408): Launched 00:47:36.488370 bus /gobi_6: Setting Powered False 00:47:37.549103 run create_hlr_db(pid=20408): Terminated: ok {rc=0} 00:47:37.992320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20410): Launched 00:47:38.318515 run osmo-hlr_10.42.42.2(pid=20411): Launched 00:47:38.443705 run osmo-stp_10.42.42.5: Starting osmo-stp 00:47:39.001958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20413): Launched 00:47:39.327700 run osmo-stp_10.42.42.5(pid=20414): Launched 00:47:39.453436 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:47:40.013260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20416): Launched 00:47:40.138737 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:47:40.413377 run patchelf(pid=20417): Launched 00:47:40.597118 run osmo-stp_10.42.42.5(pid=20414): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20414)] 00:47:40.736460 run osmo-stp_10.42.42.5(pid=20414): stdout: | (launched: 2022-12-14_00:47:39.267979) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:40.877853 run osmo-stp_10.42.42.5(pid=20414): stderr: | [0;m[38;5;43m20221214004739455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004739455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004739456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004739456 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004739456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004739457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004739457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:41.019652 run osmo-stp_10.42.42.5(pid=20414): stdout: | (launched: 2022-12-14_00:47:39.267979) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:41.154703 run osmo-stp_10.42.42.5(pid=20414): stderr: | [0;m[38;5;43m20221214004739455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004739455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004739456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004739456 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004739456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004739457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004739457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:41.314530 run patchelf(pid=20417): Terminating (SIGINT) 00:47:41.498651 run patchelf(pid=20417): Terminated: ok {rc=0} 00:47:41.631894 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20414): Process ended prematurely: osmo-stp_10.42.42.5(pid=20414) [trial-2397↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20414)] [trial-2397↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 00:47:41.642191 tst iperf3m4.py:8: Test FAILED (10.8 sec) 00:47:41.670886 run osmo-hlr_10.42.42.2(pid=20411): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20411)] 00:47:41.721403 run osmo-hlr_10.42.42.2(pid=20411): stdout: | (launched: 2022-12-14_00:47:38.258588) 00:47:41.773304 run osmo-hlr_10.42.42.2(pid=20411): stderr: | [0;m[1;31m20221214004738454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004738454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004738454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004738454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004738454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004738454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004738469 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004738477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004738477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004738477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:47:41.825340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20400): Terminating (SIGTERM) 00:47:41.867032 run iperf3-srv_10.42.42.10(pid=20401): Terminating (SIGTERM) 00:47:41.908857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20402): Terminating (SIGTERM) 00:47:41.951216 run iperf3-srv_10.42.42.10(pid=20403): Terminating (SIGTERM) 00:47:41.993574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20404): Terminating (SIGTERM) 00:47:42.036007 run iperf3-srv_10.42.42.10(pid=20405): Terminating (SIGTERM) 00:47:42.079602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20406): Terminating (SIGTERM) 00:47:42.122212 run iperf3-srv_10.42.42.10(pid=20407): Terminating (SIGTERM) 00:47:42.164055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20410): Terminating (SIGTERM) 00:47:42.206517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20413): Terminating (SIGTERM) 00:47:42.248545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20416): Terminating (SIGTERM) 00:47:42.290769 --- ParallelTerminationStrategy: PID 20400 died... 00:47:42.311059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20400): Terminated: ok {rc=0} 00:47:42.357781 --- ParallelTerminationStrategy: PID 20401 died... 00:47:42.377683 run iperf3-srv_10.42.42.10(pid=20401): Terminated {rc=256} 00:47:42.424061 --- ParallelTerminationStrategy: PID 20402 died... 00:47:42.444072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20402): Terminated: ok {rc=0} 00:47:42.490490 --- ParallelTerminationStrategy: PID 20403 died... 00:47:42.510561 run iperf3-srv_10.42.42.10(pid=20403): Terminated {rc=256} 00:47:42.556676 --- ParallelTerminationStrategy: PID 20404 died... 00:47:42.576515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20404): Terminated: ok {rc=0} 00:47:42.623028 --- ParallelTerminationStrategy: PID 20405 died... 00:47:42.643099 run iperf3-srv_10.42.42.10(pid=20405): Terminated {rc=256} 00:47:42.689384 --- ParallelTerminationStrategy: PID 20406 died... 00:47:42.709255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20406): Terminated: ok {rc=0} 00:47:42.755434 --- ParallelTerminationStrategy: PID 20407 died... 00:47:42.775543 run iperf3-srv_10.42.42.10(pid=20407): Terminated {rc=256} 00:47:42.821340 --- ParallelTerminationStrategy: PID 20410 died... 00:47:42.841175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20410): Terminated: ok {rc=0} 00:47:42.887054 --- ParallelTerminationStrategy: PID 20413 died... 00:47:42.907002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20413): Terminated: ok {rc=0} 00:47:42.953425 --- ParallelTerminationStrategy: PID 20416 died... 00:47:42.973475 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20416): Terminated: ok {rc=0} 00:47:43.062471 bus /gobi_4: Setting Powered False 00:47:44.164179 bus /gobi_4: Setting Powered False 00:47:45.282724 bus /gobi_1: Setting Powered False 00:47:46.390769 bus /gobi_1: Setting Powered False 00:47:47.522190 bus /gobi_0: Setting Powered False 00:47:48.620273 bus /gobi_0: Setting Powered False 00:47:49.736570 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 00:47:50.838947 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:50.851151 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:47:50.889719 tst ping.py: using LAC 37380 00:47:51.008773 tst ping.py: using RAC 150 00:47:51.127656 tst ping.py: using CellId 37380 00:47:51.251796 tst ping.py: using BVCI 37381 00:47:51.371478 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:51.382970 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:51.394427 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:51.405820 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:51.418344 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:51.430164 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:51.442149 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:51.453997 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:51.573501 tst ping.py:19: start network... 00:47:51.774950 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:47:52.241062 run create_hlr_db(pid=20418): Launched 00:47:52.364052 bus /gobi_6: Setting Powered False 00:47:53.423323 run create_hlr_db(pid=20418): Terminated: ok {rc=0} 00:47:53.866436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20420): Launched 00:47:54.190785 run osmo-hlr_10.42.42.2(pid=20421): Launched 00:47:54.315268 run osmo-stp_10.42.42.5: Starting osmo-stp 00:47:54.875007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20423): Launched 00:47:55.199814 run osmo-stp_10.42.42.5(pid=20424): Launched 00:47:55.324519 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:47:55.879317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20426): Launched 00:47:56.004518 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:47:56.277925 run patchelf(pid=20427): Launched 00:47:56.458262 run osmo-stp_10.42.42.5(pid=20424): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20424)] 00:47:56.595370 run osmo-stp_10.42.42.5(pid=20424): stdout: | (launched: 2022-12-14_00:47:55.140161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:56.734424 run osmo-stp_10.42.42.5(pid=20424): stderr: | [0;m[38;5;43m20221214004755331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004755332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004755332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004755332 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004755333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004755333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004755333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:56.872796 run osmo-stp_10.42.42.5(pid=20424): stdout: | (launched: 2022-12-14_00:47:55.140161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:47:57.004545 run osmo-stp_10.42.42.5(pid=20424): stderr: | [0;m[38;5;43m20221214004755331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004755332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004755332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004755332 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004755333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004755333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004755333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:47:57.161883 run patchelf(pid=20427): Terminating (SIGINT) 00:47:57.342048 run patchelf(pid=20427): Terminated: ok {rc=0} 00:47:57.471972 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20424): Process ended prematurely: osmo-stp_10.42.42.5(pid=20424) [trial-2397↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20424)] [trial-2397↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 00:47:57.481666 tst ping.py:22: Test FAILED (6.6 sec) 00:47:57.509881 run osmo-hlr_10.42.42.2(pid=20421): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20421)] 00:47:57.560829 run osmo-hlr_10.42.42.2(pid=20421): stdout: | (launched: 2022-12-14_00:47:54.131148) 00:47:57.613292 run osmo-hlr_10.42.42.2(pid=20421): stderr: | [0;m[1;31m20221214004754328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004754328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004754328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004754328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004754328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004754328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004754343 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004754353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004754353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004754353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:47:57.665695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20420): Terminating (SIGTERM) 00:47:57.707901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20423): Terminating (SIGTERM) 00:47:57.750093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20426): Terminating (SIGTERM) 00:47:57.792448 --- ParallelTerminationStrategy: PID 20420 died... 00:47:57.812772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20420): Terminated: ok {rc=0} 00:47:57.859243 --- ParallelTerminationStrategy: PID 20423 died... 00:47:57.879127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20423): Terminated: ok {rc=0} 00:47:57.925662 --- ParallelTerminationStrategy: PID 20426 died... 00:47:57.945729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20426): Terminated: ok {rc=0} 00:47:58.034820 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 00:47:59.123721 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:59.135851 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:47:59.174298 tst ping_idle_ping.py: using LAC 37381 00:47:59.302679 tst ping_idle_ping.py: using RAC 151 00:47:59.429644 tst ping_idle_ping.py: using CellId 37381 00:47:59.548487 tst ping_idle_ping.py: using BVCI 37382 00:47:59.658912 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:59.670001 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:59.680905 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:59.691650 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:59.702216 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:59.713202 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:59.724439 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:47:59.735306 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:47:59.857206 tst ping_idle_ping.py:24: start network... 00:48:00.058540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:48:00.524015 run create_hlr_db(pid=20428): Launched 00:48:00.648016 bus /gobi_6: Setting Powered False 00:48:01.762071 run create_hlr_db(pid=20428): Terminated: ok {rc=0} 00:48:02.221875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20430): Launched 00:48:02.547175 run osmo-hlr_10.42.42.2(pid=20431): Launched 00:48:02.672721 run osmo-stp_10.42.42.5: Starting osmo-stp 00:48:03.230422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20433): Launched 00:48:03.554969 run osmo-stp_10.42.42.5(pid=20434): Launched 00:48:03.679342 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:48:04.239970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20436): Launched 00:48:04.364620 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:48:04.638923 run patchelf(pid=20437): Launched 00:48:04.820772 run osmo-stp_10.42.42.5(pid=20434): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20434)] 00:48:04.957673 run osmo-stp_10.42.42.5(pid=20434): stdout: | (launched: 2022-12-14_00:48:03.495473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:05.096277 run osmo-stp_10.42.42.5(pid=20434): stderr: | [0;m[38;5;43m20221214004803688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004803688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004803688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004803689 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004803689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004803689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004803689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:05.235504 run osmo-stp_10.42.42.5(pid=20434): stdout: | (launched: 2022-12-14_00:48:03.495473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:05.367801 run osmo-stp_10.42.42.5(pid=20434): stderr: | [0;m[38;5;43m20221214004803688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004803688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004803688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004803689 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004803689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004803689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004803689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:05.524644 run patchelf(pid=20437): Terminating (SIGINT) 00:48:05.705181 run patchelf(pid=20437): Terminated: ok {rc=0} 00:48:05.835212 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20434): Process ended prematurely: osmo-stp_10.42.42.5(pid=20434) [trial-2397↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20434)] [trial-2397↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 00:48:05.844827 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 00:48:05.872800 run osmo-hlr_10.42.42.2(pid=20431): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20431)] 00:48:05.923378 run osmo-hlr_10.42.42.2(pid=20431): stdout: | (launched: 2022-12-14_00:48:02.487925) 00:48:05.975204 run osmo-hlr_10.42.42.2(pid=20431): stderr: | [0;m[1;31m20221214004802686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004802686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004802686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004802686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004802686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004802686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004802719 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004802728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004802729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004802729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:48:06.027393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20430): Terminating (SIGTERM) 00:48:06.069409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20433): Terminating (SIGTERM) 00:48:06.111009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20436): Terminating (SIGTERM) 00:48:06.153188 --- ParallelTerminationStrategy: PID 20430 died... 00:48:06.173642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20430): Terminated: ok {rc=0} 00:48:06.219984 --- ParallelTerminationStrategy: PID 20433 died... 00:48:06.239830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20433): Terminated: ok {rc=0} 00:48:06.286189 --- ParallelTerminationStrategy: PID 20436 died... 00:48:06.306185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20436): Terminated: ok {rc=0} 00:48:06.395348 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 00:48:07.691220 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:48:07.697901 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 00:48:07.719263 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 00:48:07.759246 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 00:48:07.851058 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 00:48:07.872788 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 00:48:07.912347 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 00:48:08.505585 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 00:48:08.558953 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:08.570362 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:48:08.628743 tst cs_paging_gprs_active.py: using LAC 37382 00:48:08.758352 tst cs_paging_gprs_active.py: using RAC 152 00:48:08.888769 tst cs_paging_gprs_active.py: using CellId 37382 00:48:09.019804 tst cs_paging_gprs_active.py: using BVCI 37383 00:48:09.142009 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:09.153507 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:09.164587 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:09.175956 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:09.187281 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:09.198747 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:09.210363 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:09.221745 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:09.233406 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:09.351580 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:09.471384 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:48:09.694942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:10.026702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20442): Launched 00:48:10.316100 run iperf3-srv_10.42.42.10(pid=20443): Launched 00:48:10.441544 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:48:10.663698 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:10.994829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20444): Launched 00:48:11.282940 run iperf3-srv_10.42.42.10(pid=20445): Launched 00:48:11.407950 tst cs_paging_gprs_active.py:38: start network... 00:48:11.629478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:48:12.139098 run create_hlr_db(pid=20446): Launched 00:48:12.265928 bus /gobi_6: Setting Powered False 00:48:13.326180 run create_hlr_db(pid=20446): Terminated: ok {rc=0} 00:48:13.787930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20448): Launched 00:48:14.121913 run osmo-hlr_10.42.42.2(pid=20449): Launched 00:48:14.250797 run osmo-stp_10.42.42.5: Starting osmo-stp 00:48:14.824277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20451): Launched 00:48:15.157105 run osmo-stp_10.42.42.5(pid=20452): Launched 00:48:15.285243 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:48:15.865826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20454): Launched 00:48:16.014600 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:48:16.283580 run patchelf(pid=20455): Launched 00:48:16.464742 run osmo-stp_10.42.42.5(pid=20452): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20452)] 00:48:16.600082 run osmo-stp_10.42.42.5(pid=20452): stdout: | (launched: 2022-12-14_00:48:15.095573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:16.738992 run osmo-stp_10.42.42.5(pid=20452): stderr: | [0;m[38;5;43m20221214004815288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004815288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004815288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004815289 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004815289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004815289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004815289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:16.877248 run osmo-stp_10.42.42.5(pid=20452): stdout: | (launched: 2022-12-14_00:48:15.095573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:17.007486 run osmo-stp_10.42.42.5(pid=20452): stderr: | [0;m[38;5;43m20221214004815288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004815288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004815288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004815289 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004815289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004815289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004815289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:17.162839 run patchelf(pid=20455): Terminating (SIGINT) 00:48:17.337239 run patchelf(pid=20455): Terminated: ok {rc=0} 00:48:17.461654 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20452): Process ended prematurely: osmo-stp_10.42.42.5(pid=20452) [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20452)] [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 00:48:17.471096 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 00:48:17.498261 run osmo-hlr_10.42.42.2(pid=20449): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20449)] 00:48:17.546563 run osmo-hlr_10.42.42.2(pid=20449): stdout: | (launched: 2022-12-14_00:48:14.060547) 00:48:17.596184 run osmo-hlr_10.42.42.2(pid=20449): stderr: | [0;m[1;31m20221214004814258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004814258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004814258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004814258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004814258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004814258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004814273 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004814282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004814282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004814282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:48:17.646042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20442): Terminating (SIGTERM) 00:48:17.685849 run iperf3-srv_10.42.42.10(pid=20443): Terminating (SIGTERM) 00:48:17.725577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20444): Terminating (SIGTERM) 00:48:17.765290 run iperf3-srv_10.42.42.10(pid=20445): Terminating (SIGTERM) 00:48:17.805119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20448): Terminating (SIGTERM) 00:48:17.845060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20451): Terminating (SIGTERM) 00:48:17.884791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20454): Terminating (SIGTERM) 00:48:17.924770 --- ParallelTerminationStrategy: PID 20442 died... 00:48:17.944175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20442): Terminated: ok {rc=0} 00:48:17.988458 --- ParallelTerminationStrategy: PID 20443 died... 00:48:18.007429 run iperf3-srv_10.42.42.10(pid=20443): Terminated {rc=256} 00:48:18.051171 --- ParallelTerminationStrategy: PID 20444 died... 00:48:18.070055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20444): Terminated: ok {rc=0} 00:48:18.113767 --- ParallelTerminationStrategy: PID 20445 died... 00:48:18.132638 run iperf3-srv_10.42.42.10(pid=20445): Terminated {rc=256} 00:48:18.176480 --- ParallelTerminationStrategy: PID 20448 died... 00:48:18.195593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20448): Terminated: ok {rc=0} 00:48:18.239408 --- ParallelTerminationStrategy: PID 20451 died... 00:48:18.258407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20451): Terminated: ok {rc=0} 00:48:18.302144 --- ParallelTerminationStrategy: PID 20454 died... 00:48:18.321115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20454): Terminated: ok {rc=0} 00:48:18.407398 bus /gobi_0: Setting Powered False 00:48:19.506654 bus /gobi_0: Setting Powered False 00:48:20.619743 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 00:48:21.766694 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:21.778274 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:48:21.837975 tst iperf3.py: using LAC 37383 00:48:21.961065 tst iperf3.py: using RAC 153 00:48:22.083560 tst iperf3.py: using CellId 37383 00:48:22.215074 tst iperf3.py: using BVCI 37384 00:48:22.334615 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:22.346341 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:22.357819 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:22.369187 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:22.380760 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:22.392223 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:22.403819 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:22.415195 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:22.427344 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:22.543952 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:48:22.768082 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:23.099825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20456): Launched 00:48:23.389996 run iperf3-srv_10.42.42.10(pid=20457): Launched 00:48:23.515696 tst iperf3.py:8: start network... 00:48:23.738300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:48:24.249635 run create_hlr_db(pid=20458): Launched 00:48:24.377468 bus /gobi_6: Setting Powered False 00:48:25.442293 run create_hlr_db(pid=20458): Terminated: ok {rc=0} 00:48:25.899538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20460): Launched 00:48:26.231743 run osmo-hlr_10.42.42.2(pid=20461): Launched 00:48:26.357592 run osmo-stp_10.42.42.5: Starting osmo-stp 00:48:26.926908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20463): Launched 00:48:27.257073 run osmo-stp_10.42.42.5(pid=20464): Launched 00:48:27.382839 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:48:27.950547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20466): Launched 00:48:28.078223 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:48:28.356801 run patchelf(pid=20467): Launched 00:48:28.541646 run osmo-stp_10.42.42.5(pid=20464): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20464)] 00:48:28.680687 run osmo-stp_10.42.42.5(pid=20464): stdout: | (launched: 2022-12-14_00:48:27.196274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:28.822011 run osmo-stp_10.42.42.5(pid=20464): stderr: | [0;m[38;5;43m20221214004827388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004827389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004827389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004827389 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004827390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004827390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004827390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:28.963874 run osmo-stp_10.42.42.5(pid=20464): stdout: | (launched: 2022-12-14_00:48:27.196274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:29.098476 run osmo-stp_10.42.42.5(pid=20464): stderr: | [0;m[38;5;43m20221214004827388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004827389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004827389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004827389 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004827390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004827390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004827390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:29.258688 run patchelf(pid=20467): Terminating (SIGINT) 00:48:29.442018 run patchelf(pid=20467): Terminated: ok {rc=0} 00:48:29.575337 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20464): Process ended prematurely: osmo-stp_10.42.42.5(pid=20464) [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20464)] [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 00:48:29.585666 tst iperf3.py:8: Test FAILED (7.9 sec) 00:48:29.614328 run osmo-hlr_10.42.42.2(pid=20461): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20461)] 00:48:29.664910 run osmo-hlr_10.42.42.2(pid=20461): stdout: | (launched: 2022-12-14_00:48:26.170960) 00:48:29.716639 run osmo-hlr_10.42.42.2(pid=20461): stderr: | [0;m[1;31m20221214004826369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004826369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004826369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004826369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004826369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004826369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004826382 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004826391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004826391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004826391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:48:29.768782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20456): Terminating (SIGTERM) 00:48:29.810742 run iperf3-srv_10.42.42.10(pid=20457): Terminating (SIGTERM) 00:48:29.852401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20460): Terminating (SIGTERM) 00:48:29.894953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20463): Terminating (SIGTERM) 00:48:29.937387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20466): Terminating (SIGTERM) 00:48:29.980313 --- ParallelTerminationStrategy: PID 20456 died... 00:48:30.000844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20456): Terminated: ok {rc=0} 00:48:30.048111 --- ParallelTerminationStrategy: PID 20457 died... 00:48:30.068044 run iperf3-srv_10.42.42.10(pid=20457): Terminated {rc=256} 00:48:30.114085 --- ParallelTerminationStrategy: PID 20460 died... 00:48:30.134184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20460): Terminated: ok {rc=0} 00:48:30.180166 --- ParallelTerminationStrategy: PID 20463 died... 00:48:30.200030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20463): Terminated: ok {rc=0} 00:48:30.246334 --- ParallelTerminationStrategy: PID 20466 died... 00:48:30.266276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20466): Terminated: ok {rc=0} 00:48:30.355202 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 00:48:31.531799 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:31.548444 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:48:31.626891 tst iperf3m4.py: using LAC 37384 00:48:31.749746 tst iperf3m4.py: using RAC 154 00:48:31.893197 tst iperf3m4.py: using CellId 37384 00:48:32.066470 tst iperf3m4.py: using BVCI 37385 00:48:32.188668 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:32.201006 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:32.212930 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:32.224816 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:32.237614 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:32.250316 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:32.263242 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:32.275878 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:32.288750 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:32.411926 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:32.533619 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:32.655197 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:32.773511 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:48:32.980101 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:33.289091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20468): Launched 00:48:33.557664 run iperf3-srv_10.42.42.10(pid=20469): Launched 00:48:33.675939 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:48:33.882314 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:34.192559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20470): Launched 00:48:34.460766 run iperf3-srv_10.42.42.10(pid=20471): Launched 00:48:34.575911 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:48:34.779675 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:35.088470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20472): Launched 00:48:35.358235 run iperf3-srv_10.42.42.10(pid=20473): Launched 00:48:35.474621 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:48:35.678468 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:48:35.986655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20474): Launched 00:48:36.257678 run iperf3-srv_10.42.42.10(pid=20475): Launched 00:48:36.374958 tst iperf3m4.py:8: start network... 00:48:36.579997 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:48:37.059428 run create_hlr_db(pid=20476): Launched 00:48:37.186283 bus /gobi_6: Setting Powered False 00:48:38.246755 run create_hlr_db(pid=20476): Terminated: ok {rc=0} 00:48:38.696069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20478): Launched 00:48:39.027657 run osmo-hlr_10.42.42.2(pid=20479): Launched 00:48:39.154526 run osmo-stp_10.42.42.5: Starting osmo-stp 00:48:39.724459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20481): Launched 00:48:40.055749 run osmo-stp_10.42.42.5(pid=20482): Launched 00:48:40.182831 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:48:40.749658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20484): Launched 00:48:40.877416 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:48:41.155439 run patchelf(pid=20485): Launched 00:48:41.340356 run osmo-stp_10.42.42.5(pid=20482): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20482)] 00:48:41.479747 run osmo-stp_10.42.42.5(pid=20482): stdout: | (launched: 2022-12-14_00:48:39.995247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:41.621264 run osmo-stp_10.42.42.5(pid=20482): stderr: | [0;m[38;5;43m20221214004840184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004840184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004840185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004840185 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004840186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004840186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004840186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:41.762337 run osmo-stp_10.42.42.5(pid=20482): stdout: | (launched: 2022-12-14_00:48:39.995247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:41.897167 run osmo-stp_10.42.42.5(pid=20482): stderr: | [0;m[38;5;43m20221214004840184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004840184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004840185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004840185 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004840186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004840186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004840186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:42.056385 run patchelf(pid=20485): Terminating (SIGINT) 00:48:42.240893 run patchelf(pid=20485): Terminated: ok {rc=0} 00:48:42.374083 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20482): Process ended prematurely: osmo-stp_10.42.42.5(pid=20482) [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20482)] [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 00:48:42.384295 tst iperf3m4.py:8: Test FAILED (10.9 sec) 00:48:42.413173 run osmo-hlr_10.42.42.2(pid=20479): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20479)] 00:48:42.464013 run osmo-hlr_10.42.42.2(pid=20479): stdout: | (launched: 2022-12-14_00:48:38.967214) 00:48:42.516120 run osmo-hlr_10.42.42.2(pid=20479): stderr: | [0;m[1;31m20221214004839161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004839161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004839161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004839161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004839161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004839162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004839174 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004839183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004839183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004839183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:48:42.568503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20468): Terminating (SIGTERM) 00:48:42.610893 run iperf3-srv_10.42.42.10(pid=20469): Terminating (SIGTERM) 00:48:42.652925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20470): Terminating (SIGTERM) 00:48:42.695657 run iperf3-srv_10.42.42.10(pid=20471): Terminating (SIGTERM) 00:48:42.738212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20472): Terminating (SIGTERM) 00:48:42.780306 run iperf3-srv_10.42.42.10(pid=20473): Terminating (SIGTERM) 00:48:42.822878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20474): Terminating (SIGTERM) 00:48:42.865233 run iperf3-srv_10.42.42.10(pid=20475): Terminating (SIGTERM) 00:48:42.907267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20478): Terminating (SIGTERM) 00:48:42.949519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20481): Terminating (SIGTERM) 00:48:42.991970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20484): Terminating (SIGTERM) 00:48:43.034411 --- ParallelTerminationStrategy: PID 20468 died... 00:48:43.054889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20468): Terminated: ok {rc=0} 00:48:43.101795 --- ParallelTerminationStrategy: PID 20469 died... 00:48:43.121758 run iperf3-srv_10.42.42.10(pid=20469): Terminated {rc=256} 00:48:43.168196 --- ParallelTerminationStrategy: PID 20470 died... 00:48:43.188248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20470): Terminated: ok {rc=0} 00:48:43.234814 --- ParallelTerminationStrategy: PID 20471 died... 00:48:43.254821 run iperf3-srv_10.42.42.10(pid=20471): Terminated {rc=256} 00:48:43.301200 --- ParallelTerminationStrategy: PID 20472 died... 00:48:43.321177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20472): Terminated: ok {rc=0} 00:48:43.367876 --- ParallelTerminationStrategy: PID 20473 died... 00:48:43.387914 run iperf3-srv_10.42.42.10(pid=20473): Terminated {rc=256} 00:48:43.434529 --- ParallelTerminationStrategy: PID 20474 died... 00:48:43.454472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20474): Terminated: ok {rc=0} 00:48:43.500882 --- ParallelTerminationStrategy: PID 20475 died... 00:48:43.521294 run iperf3-srv_10.42.42.10(pid=20475): Terminated {rc=256} 00:48:43.567601 --- ParallelTerminationStrategy: PID 20478 died... 00:48:43.587801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20478): Terminated: ok {rc=0} 00:48:43.634463 --- ParallelTerminationStrategy: PID 20481 died... 00:48:43.654445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20481): Terminated: ok {rc=0} 00:48:43.701024 --- ParallelTerminationStrategy: PID 20484 died... 00:48:43.721065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20484): Terminated: ok {rc=0} 00:48:43.810347 bus /gobi_4: Setting Powered False 00:48:44.909412 bus /gobi_4: Setting Powered False 00:48:46.033630 bus /gobi_1: Setting Powered False 00:48:47.150903 bus /gobi_1: Setting Powered False 00:48:48.275797 bus /gobi_0: Setting Powered False 00:48:49.374318 bus /gobi_0: Setting Powered False 00:48:50.491528 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 00:48:51.594680 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:51.606815 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:48:51.666404 tst ping.py: using LAC 37385 00:48:51.795095 tst ping.py: using RAC 155 00:48:51.922330 tst ping.py: using CellId 37385 00:48:52.050684 tst ping.py: using BVCI 37386 00:48:52.168867 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:52.180358 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:52.191603 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:52.202994 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:52.214559 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:52.226003 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:52.237658 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:52.249131 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:48:52.365605 tst ping.py:19: start network... 00:48:52.567156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:48:53.035677 run create_hlr_db(pid=20486): Launched 00:48:53.161340 bus /gobi_6: Setting Powered False 00:48:54.221483 run create_hlr_db(pid=20486): Terminated: ok {rc=0} 00:48:54.666031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20488): Launched 00:48:54.993297 run osmo-hlr_10.42.42.2(pid=20489): Launched 00:48:55.117201 run osmo-stp_10.42.42.5: Starting osmo-stp 00:48:55.689170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20491): Launched 00:48:56.014341 run osmo-stp_10.42.42.5(pid=20492): Launched 00:48:56.138828 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:48:56.695601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20494): Launched 00:48:56.821277 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:48:57.094219 run patchelf(pid=20495): Launched 00:48:57.275482 run osmo-stp_10.42.42.5(pid=20492): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20492)] 00:48:57.411994 run osmo-stp_10.42.42.5(pid=20492): stdout: | (launched: 2022-12-14_00:48:55.954604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:57.550818 run osmo-stp_10.42.42.5(pid=20492): stderr: | [0;m[38;5;43m20221214004856146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004856146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004856146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004856146 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004856147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004856147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004856147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:57.689350 run osmo-stp_10.42.42.5(pid=20492): stdout: | (launched: 2022-12-14_00:48:55.954604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:48:57.821147 run osmo-stp_10.42.42.5(pid=20492): stderr: | [0;m[38;5;43m20221214004856146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004856146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004856146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004856146 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004856147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004856147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004856147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:48:57.977575 run patchelf(pid=20495): Terminating (SIGINT) 00:48:58.157908 run patchelf(pid=20495): Terminated: ok {rc=0} 00:48:58.287878 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20492): Process ended prematurely: osmo-stp_10.42.42.5(pid=20492) [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20492)] [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 00:48:58.297585 tst ping.py:22: Test FAILED (6.7 sec) 00:48:58.325688 run osmo-hlr_10.42.42.2(pid=20489): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20489)] 00:48:58.376138 run osmo-hlr_10.42.42.2(pid=20489): stdout: | (launched: 2022-12-14_00:48:54.933365) 00:48:58.428115 run osmo-hlr_10.42.42.2(pid=20489): stderr: | [0;m[1;31m20221214004855131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004855131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004855131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004855131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004855131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004855131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004855142 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004855150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004855151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004855151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:48:58.479908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20488): Terminating (SIGTERM) 00:48:58.521823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20491): Terminating (SIGTERM) 00:48:58.563455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20494): Terminating (SIGTERM) 00:48:58.605416 --- ParallelTerminationStrategy: PID 20488 died... 00:48:58.625736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20488): Terminated: ok {rc=0} 00:48:58.671848 --- ParallelTerminationStrategy: PID 20491 died... 00:48:58.691700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20491): Terminated: ok {rc=0} 00:48:58.737421 --- ParallelTerminationStrategy: PID 20494 died... 00:48:58.757198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20494): Terminated: ok {rc=0} 00:48:58.845848 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 00:48:59.932928 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:48:59.945076 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:49:00.003708 tst ping_idle_ping.py: using LAC 37386 00:49:00.132910 tst ping_idle_ping.py: using RAC 156 00:49:00.261266 tst ping_idle_ping.py: using CellId 37386 00:49:00.386867 tst ping_idle_ping.py: using BVCI 37387 00:49:00.504495 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:00.515932 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:00.527180 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:00.538360 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:00.549897 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:00.561290 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:00.572734 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:49:00.584237 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:49:00.704375 tst ping_idle_ping.py:24: start network... 00:49:00.945556 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:49:01.454542 run create_hlr_db(pid=20496): Launched 00:49:01.613856 bus /gobi_6: Setting Powered False 00:49:02.678363 run create_hlr_db(pid=20496): Terminated: ok {rc=0} 00:49:03.132139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20498): Launched 00:49:03.460417 run osmo-hlr_10.42.42.2(pid=20499): Launched 00:49:03.587167 run osmo-stp_10.42.42.5: Starting osmo-stp 00:49:04.146018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20501): Launched 00:49:04.471234 run osmo-stp_10.42.42.5(pid=20502): Launched 00:49:04.599812 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:49:05.161828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20504): Launched 00:49:05.287097 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:49:05.562639 run patchelf(pid=20505): Launched 00:49:05.744466 run osmo-stp_10.42.42.5(pid=20502): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20502)] 00:49:05.881842 run osmo-stp_10.42.42.5(pid=20502): stdout: | (launched: 2022-12-14_00:49:04.411309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:06.020728 run osmo-stp_10.42.42.5(pid=20502): stderr: | [0;m[38;5;43m20221214004904602 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004904603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004904603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004904603 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004904604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004904604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004904604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:06.160237 run osmo-stp_10.42.42.5(pid=20502): stdout: | (launched: 2022-12-14_00:49:04.411309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:06.292890 run osmo-stp_10.42.42.5(pid=20502): stderr: | [0;m[38;5;43m20221214004904602 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004904603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004904603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004904603 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004904604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004904604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004904604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:06.450381 run patchelf(pid=20505): Terminating (SIGINT) 00:49:06.631060 run patchelf(pid=20505): Terminated: ok {rc=0} 00:49:06.761403 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20502): Process ended prematurely: osmo-stp_10.42.42.5(pid=20502) [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20502)] [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 00:49:06.771084 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 00:49:06.799227 run osmo-hlr_10.42.42.2(pid=20499): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20499)] 00:49:06.850010 run osmo-hlr_10.42.42.2(pid=20499): stdout: | (launched: 2022-12-14_00:49:03.400345) 00:49:06.902177 run osmo-hlr_10.42.42.2(pid=20499): stderr: | [0;m[1;31m20221214004903597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004903597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004903597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004903597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004903597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004903597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004903610 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004903619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004903619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004903619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:49:06.954988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20498): Terminating (SIGTERM) 00:49:06.997060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20501): Terminating (SIGTERM) 00:49:07.038919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20504): Terminating (SIGTERM) 00:49:07.081684 --- ParallelTerminationStrategy: PID 20498 died... 00:49:07.102479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20498): Terminated: ok {rc=0} 00:49:07.148934 --- ParallelTerminationStrategy: PID 20501 died... 00:49:07.169133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20501): Terminated: ok {rc=0} 00:49:07.215445 --- ParallelTerminationStrategy: PID 20504 died... 00:49:07.235614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20504): Terminated: ok {rc=0} 00:49:07.323437 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:49:08.618749 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:49:08.625263 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:49:08.646610 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 00:49:08.686652 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 00:49:08.778430 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:49:08.800263 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 00:49:08.839818 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 00:49:09.433626 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 00:49:09.486845 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:09.498222 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:49:09.556765 tst cs_paging_gprs_active.py: using LAC 37387 00:49:09.685273 tst cs_paging_gprs_active.py: using RAC 157 00:49:09.813529 tst cs_paging_gprs_active.py: using CellId 37387 00:49:09.934451 tst cs_paging_gprs_active.py: using BVCI 37388 00:49:10.047770 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:10.058715 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:10.069583 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:10.080268 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:10.090905 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:10.101670 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:10.112338 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:10.123455 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:10.134261 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:10.251343 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:10.372889 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:49:10.579565 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:49:10.887467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20510): Launched 00:49:11.157474 run iperf3-srv_10.42.42.10(pid=20511): Launched 00:49:11.272879 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:49:11.478965 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:49:11.787326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20512): Launched 00:49:12.054959 run iperf3-srv_10.42.42.10(pid=20513): Launched 00:49:12.169860 tst cs_paging_gprs_active.py:38: start network... 00:49:12.374315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:49:12.850188 run create_hlr_db(pid=20514): Launched 00:49:12.976248 bus /gobi_6: Setting Powered False 00:49:14.037501 run create_hlr_db(pid=20514): Terminated: ok {rc=0} 00:49:14.464733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20516): Launched 00:49:14.771950 run osmo-hlr_10.42.42.2(pid=20517): Launched 00:49:14.890422 run osmo-stp_10.42.42.5: Starting osmo-stp 00:49:15.419103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20519): Launched 00:49:15.725772 run osmo-stp_10.42.42.5(pid=20520): Launched 00:49:15.856051 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:49:16.689188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20522): Launched 00:49:16.823302 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:49:17.092508 run patchelf(pid=20523): Launched 00:49:17.280647 run osmo-stp_10.42.42.5(pid=20520): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20520)] 00:49:17.411372 run osmo-stp_10.42.42.5(pid=20520): stdout: | (launched: 2022-12-14_00:49:15.668566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:17.543308 run osmo-stp_10.42.42.5(pid=20520): stderr: | [0;m[38;5;43m20221214004915876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004915876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004915876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004915880 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004915881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004915881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004915881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:17.674952 run osmo-stp_10.42.42.5(pid=20520): stdout: | (launched: 2022-12-14_00:49:15.668566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:17.800257 run osmo-stp_10.42.42.5(pid=20520): stderr: | [0;m[38;5;43m20221214004915876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004915876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004915876 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004915880 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004915881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004915881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004915881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:17.949086 run patchelf(pid=20523): Terminating (SIGINT) 00:49:18.121768 run patchelf(pid=20523): Terminated: ok {rc=0} 00:49:18.245738 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20520): Process ended prematurely: osmo-stp_10.42.42.5(pid=20520) [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20520)] [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 00:49:18.255255 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 00:49:18.282464 run osmo-hlr_10.42.42.2(pid=20517): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20517)] 00:49:18.330172 run osmo-hlr_10.42.42.2(pid=20517): stdout: | (launched: 2022-12-14_00:49:14.714921) 00:49:18.379327 run osmo-hlr_10.42.42.2(pid=20517): stderr: | [0;m[1;31m20221214004914894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004914894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004914894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004914894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004914894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004914895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004914907 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004914916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004914916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004914916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:49:18.428791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20510): Terminating (SIGTERM) 00:49:18.468361 run iperf3-srv_10.42.42.10(pid=20511): Terminating (SIGTERM) 00:49:18.507975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20512): Terminating (SIGTERM) 00:49:18.547587 run iperf3-srv_10.42.42.10(pid=20513): Terminating (SIGTERM) 00:49:18.586912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20516): Terminating (SIGTERM) 00:49:18.626416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20519): Terminating (SIGTERM) 00:49:18.665779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20522): Terminating (SIGTERM) 00:49:18.705385 --- ParallelTerminationStrategy: PID 20510 died... 00:49:18.724482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20510): Terminated: ok {rc=0} 00:49:18.768547 --- ParallelTerminationStrategy: PID 20511 died... 00:49:18.787173 run iperf3-srv_10.42.42.10(pid=20511): Terminated {rc=256} 00:49:18.830822 --- ParallelTerminationStrategy: PID 20512 died... 00:49:18.849401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20512): Terminated: ok {rc=0} 00:49:18.893167 --- ParallelTerminationStrategy: PID 20513 died... 00:49:18.911617 run iperf3-srv_10.42.42.10(pid=20513): Terminated {rc=256} 00:49:18.955531 --- ParallelTerminationStrategy: PID 20516 died... 00:49:18.974226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20516): Terminated: ok {rc=0} 00:49:19.017954 --- ParallelTerminationStrategy: PID 20519 died... 00:49:19.036527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20519): Terminated: ok {rc=0} 00:49:19.080059 --- ParallelTerminationStrategy: PID 20522 died... 00:49:19.098681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20522): Terminated: ok {rc=0} 00:49:19.184676 bus /gobi_0: Setting Powered False 00:49:20.283960 bus /gobi_0: Setting Powered False 00:49:21.397053 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 00:49:22.542314 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:22.553945 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:49:22.614842 tst iperf3.py: using LAC 37388 00:49:22.735853 tst iperf3.py: using RAC 158 00:49:22.856699 tst iperf3.py: using CellId 37388 00:49:22.977087 tst iperf3.py: using BVCI 37389 00:49:23.088941 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:23.100022 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:23.110754 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:23.121546 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:23.132241 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:23.142933 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:23.153727 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:23.164245 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:23.175170 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:23.289066 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:49:23.494685 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:49:23.828750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20524): Launched 00:49:24.118312 run iperf3-srv_10.42.42.10(pid=20525): Launched 00:49:24.244121 tst iperf3.py:8: start network... 00:49:24.466772 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:49:24.976459 run create_hlr_db(pid=20526): Launched 00:49:25.103557 bus /gobi_6: Setting Powered False 00:49:26.168397 run create_hlr_db(pid=20526): Terminated: ok {rc=0} 00:49:26.627011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20528): Launched 00:49:26.956205 run osmo-hlr_10.42.42.2(pid=20529): Launched 00:49:27.083813 run osmo-stp_10.42.42.5: Starting osmo-stp 00:49:27.659928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20531): Launched 00:49:27.991887 run osmo-stp_10.42.42.5(pid=20532): Launched 00:49:28.119473 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:49:28.687009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20534): Launched 00:49:28.813983 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:49:29.092482 run patchelf(pid=20535): Launched 00:49:29.279096 run osmo-stp_10.42.42.5(pid=20532): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20532)] 00:49:29.418996 run osmo-stp_10.42.42.5(pid=20532): stdout: | (launched: 2022-12-14_00:49:27.931483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:29.560840 run osmo-stp_10.42.42.5(pid=20532): stderr: | [0;m[38;5;43m20221214004928122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004928123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004928123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004928123 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004928124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004928124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004928124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:29.702877 run osmo-stp_10.42.42.5(pid=20532): stdout: | (launched: 2022-12-14_00:49:27.931483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:29.837958 run osmo-stp_10.42.42.5(pid=20532): stderr: | [0;m[38;5;43m20221214004928122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004928123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004928123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004928123 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004928124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004928124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004928124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:29.998181 run patchelf(pid=20535): Terminating (SIGINT) 00:49:30.182850 run patchelf(pid=20535): Terminated: ok {rc=0} 00:49:30.316355 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20532): Process ended prematurely: osmo-stp_10.42.42.5(pid=20532) [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20532)] [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 00:49:30.326807 tst iperf3.py:8: Test FAILED (7.8 sec) 00:49:30.355458 run osmo-hlr_10.42.42.2(pid=20529): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20529)] 00:49:30.406229 run osmo-hlr_10.42.42.2(pid=20529): stdout: | (launched: 2022-12-14_00:49:26.895694) 00:49:30.458684 run osmo-hlr_10.42.42.2(pid=20529): stderr: | [0;m[1;31m20221214004927093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004927093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004927093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004927093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004927093 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004927094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004927106 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004927114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004927114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004927114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:49:30.511297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20524): Terminating (SIGTERM) 00:49:30.553519 run iperf3-srv_10.42.42.10(pid=20525): Terminating (SIGTERM) 00:49:30.595662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20528): Terminating (SIGTERM) 00:49:30.638312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20531): Terminating (SIGTERM) 00:49:30.680310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20534): Terminating (SIGTERM) 00:49:30.723328 --- ParallelTerminationStrategy: PID 20524 died... 00:49:30.744089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20524): Terminated: ok {rc=0} 00:49:30.790682 --- ParallelTerminationStrategy: PID 20525 died... 00:49:30.810479 run iperf3-srv_10.42.42.10(pid=20525): Terminated {rc=256} 00:49:30.861598 --- ParallelTerminationStrategy: PID 20528 died... 00:49:30.888643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20528): Terminated: ok {rc=0} 00:49:30.937821 --- ParallelTerminationStrategy: PID 20531 died... 00:49:30.959104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20531): Terminated: ok {rc=0} 00:49:31.007133 --- ParallelTerminationStrategy: PID 20534 died... 00:49:31.028372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20534): Terminated: ok {rc=0} 00:49:31.120089 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 00:49:32.269222 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:32.281436 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:49:32.340775 tst iperf3m4.py: using LAC 37389 00:49:32.462661 tst iperf3m4.py: using RAC 159 00:49:32.584160 tst iperf3m4.py: using CellId 37389 00:49:32.707370 tst iperf3m4.py: using BVCI 37390 00:49:32.820031 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:32.831090 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:32.841890 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:32.852624 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:32.863894 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:32.875259 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:32.886616 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:32.897789 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:32.909271 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:33.030977 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:33.151926 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:33.270975 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:33.389069 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:49:33.594694 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:49:33.902798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20536): Launched 00:49:34.171028 run iperf3-srv_10.42.42.10(pid=20537): Launched 00:49:34.287676 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:49:34.491640 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:49:34.798579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20538): Launched 00:49:35.067862 run iperf3-srv_10.42.42.10(pid=20539): Launched 00:49:35.182645 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:49:35.387848 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:49:35.694848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20540): Launched 00:49:35.964267 run iperf3-srv_10.42.42.10(pid=20541): Launched 00:49:36.080696 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:49:36.284814 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:49:36.592273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20542): Launched 00:49:36.862257 run iperf3-srv_10.42.42.10(pid=20543): Launched 00:49:36.978533 tst iperf3m4.py:8: start network... 00:49:37.182226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:49:37.656609 run create_hlr_db(pid=20544): Launched 00:49:37.781575 bus /gobi_6: Setting Powered False 00:49:38.842875 run create_hlr_db(pid=20544): Terminated: ok {rc=0} 00:49:39.271979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20546): Launched 00:49:39.582455 run osmo-hlr_10.42.42.2(pid=20547): Launched 00:49:39.698280 run osmo-stp_10.42.42.5: Starting osmo-stp 00:49:40.247051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20549): Launched 00:49:40.556389 run osmo-stp_10.42.42.5(pid=20550): Launched 00:49:40.672306 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:49:41.201075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20552): Launched 00:49:41.319050 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:49:41.579363 run patchelf(pid=20553): Launched 00:49:41.752357 run osmo-stp_10.42.42.5(pid=20550): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20550)] 00:49:41.882962 run osmo-stp_10.42.42.5(pid=20550): stdout: | (launched: 2022-12-14_00:49:40.499460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:42.015612 run osmo-stp_10.42.42.5(pid=20550): stderr: | [0;m[38;5;43m20221214004940667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004940667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004940668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004940668 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004940668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004940669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004940669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:42.148587 run osmo-stp_10.42.42.5(pid=20550): stdout: | (launched: 2022-12-14_00:49:40.499460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:42.274317 run osmo-stp_10.42.42.5(pid=20550): stderr: | [0;m[38;5;43m20221214004940667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004940667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004940668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004940668 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004940668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004940669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004940669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:42.423704 run patchelf(pid=20553): Terminating (SIGINT) 00:49:42.596153 run patchelf(pid=20553): Terminated: ok {rc=0} 00:49:42.721602 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20550): Process ended prematurely: osmo-stp_10.42.42.5(pid=20550) [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20550)] [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 00:49:42.731278 tst iperf3m4.py:8: Test FAILED (10.5 sec) 00:49:42.758631 run osmo-hlr_10.42.42.2(pid=20547): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20547)] 00:49:42.805727 run osmo-hlr_10.42.42.2(pid=20547): stdout: | (launched: 2022-12-14_00:49:39.525209) 00:49:42.854806 run osmo-hlr_10.42.42.2(pid=20547): stderr: | [0;m[1;31m20221214004939702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004939702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004939702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004939702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004939702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004939702 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004939714 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004939723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004939723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004939723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:49:42.903974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20536): Terminating (SIGTERM) 00:49:42.943091 run iperf3-srv_10.42.42.10(pid=20537): Terminating (SIGTERM) 00:49:42.982111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20538): Terminating (SIGTERM) 00:49:43.021556 run iperf3-srv_10.42.42.10(pid=20539): Terminating (SIGTERM) 00:49:43.061060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20540): Terminating (SIGTERM) 00:49:43.101055 run iperf3-srv_10.42.42.10(pid=20541): Terminating (SIGTERM) 00:49:43.140474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20542): Terminating (SIGTERM) 00:49:43.179826 run iperf3-srv_10.42.42.10(pid=20543): Terminating (SIGTERM) 00:49:43.219011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20546): Terminating (SIGTERM) 00:49:43.258511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20549): Terminating (SIGTERM) 00:49:43.297807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20552): Terminating (SIGTERM) 00:49:43.337944 --- ParallelTerminationStrategy: PID 20536 died... 00:49:43.357274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20536): Terminated: ok {rc=0} 00:49:43.401162 --- ParallelTerminationStrategy: PID 20537 died... 00:49:43.419530 run iperf3-srv_10.42.42.10(pid=20537): Terminated {rc=256} 00:49:43.463230 --- ParallelTerminationStrategy: PID 20538 died... 00:49:43.481933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20538): Terminated: ok {rc=0} 00:49:43.525600 --- ParallelTerminationStrategy: PID 20539 died... 00:49:43.544113 run iperf3-srv_10.42.42.10(pid=20539): Terminated {rc=256} 00:49:43.587593 --- ParallelTerminationStrategy: PID 20540 died... 00:49:43.606132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20540): Terminated: ok {rc=0} 00:49:43.649723 --- ParallelTerminationStrategy: PID 20541 died... 00:49:43.668349 run iperf3-srv_10.42.42.10(pid=20541): Terminated {rc=256} 00:49:43.711919 --- ParallelTerminationStrategy: PID 20542 died... 00:49:43.730510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20542): Terminated: ok {rc=0} 00:49:43.774129 --- ParallelTerminationStrategy: PID 20543 died... 00:49:43.792760 run iperf3-srv_10.42.42.10(pid=20543): Terminated {rc=256} 00:49:43.836350 --- ParallelTerminationStrategy: PID 20546 died... 00:49:43.855042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20546): Terminated: ok {rc=0} 00:49:43.898810 --- ParallelTerminationStrategy: PID 20549 died... 00:49:43.917479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20549): Terminated: ok {rc=0} 00:49:43.961192 --- ParallelTerminationStrategy: PID 20552 died... 00:49:43.979722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20552): Terminated: ok {rc=0} 00:49:44.066098 bus /gobi_4: Setting Powered False 00:49:45.168163 bus /gobi_4: Setting Powered False 00:49:46.280609 bus /gobi_1: Setting Powered False 00:49:47.381284 bus /gobi_1: Setting Powered False 00:49:48.497964 bus /gobi_0: Setting Powered False 00:49:49.593419 bus /gobi_0: Setting Powered False 00:49:50.710536 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 00:49:51.813134 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:51.825356 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:49:51.885250 tst ping.py: using LAC 37390 00:49:52.013137 tst ping.py: using RAC 160 00:49:52.139618 tst ping.py: using CellId 37390 00:49:52.267664 tst ping.py: using BVCI 37391 00:49:52.386851 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:52.398510 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:52.409774 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:52.421073 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:52.432798 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:52.444203 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:52.455848 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:52.467371 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:49:52.583675 tst ping.py:19: start network... 00:49:52.785064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:49:53.251656 run create_hlr_db(pid=20554): Launched 00:49:53.375320 bus /gobi_6: Setting Powered False 00:49:54.435214 run create_hlr_db(pid=20554): Terminated: ok {rc=0} 00:49:54.878980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20556): Launched 00:49:55.205581 run osmo-hlr_10.42.42.2(pid=20557): Launched 00:49:55.331123 run osmo-stp_10.42.42.5: Starting osmo-stp 00:49:55.894428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20559): Launched 00:49:56.220465 run osmo-stp_10.42.42.5(pid=20560): Launched 00:49:56.342656 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:49:56.864111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20562): Launched 00:49:56.980281 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:49:57.234625 run patchelf(pid=20563): Launched 00:49:57.402324 run osmo-stp_10.42.42.5(pid=20560): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20560)] 00:49:57.530180 run osmo-stp_10.42.42.5(pid=20560): stdout: | (launched: 2022-12-14_00:49:56.160297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:57.659534 run osmo-stp_10.42.42.5(pid=20560): stderr: | [0;m[38;5;43m20221214004956332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004956332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004956332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004956333 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004956333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004956333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004956333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:57.788448 run osmo-stp_10.42.42.5(pid=20560): stdout: | (launched: 2022-12-14_00:49:56.160297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:49:57.911663 run osmo-stp_10.42.42.5(pid=20560): stderr: | [0;m[38;5;43m20221214004956332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214004956332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214004956332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214004956333 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214004956333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214004956333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214004956333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:49:58.056908 run patchelf(pid=20563): Terminating (SIGINT) 00:49:58.225416 run patchelf(pid=20563): Terminated: ok {rc=0} 00:49:58.346627 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20560): Process ended prematurely: osmo-stp_10.42.42.5(pid=20560) [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20560)] [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 00:49:58.355572 tst ping.py:22: Test FAILED (6.5 sec) 00:49:58.382676 run osmo-hlr_10.42.42.2(pid=20557): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20557)] 00:49:58.430728 run osmo-hlr_10.42.42.2(pid=20557): stdout: | (launched: 2022-12-14_00:49:55.145398) 00:49:58.480301 run osmo-hlr_10.42.42.2(pid=20557): stderr: | [0;m[1;31m20221214004955342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214004955342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214004955342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214004955342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214004955342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214004955342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214004955357 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214004955365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214004955365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214004955365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:49:58.530231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20556): Terminating (SIGTERM) 00:49:58.570432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20559): Terminating (SIGTERM) 00:49:58.610523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20562): Terminating (SIGTERM) 00:49:58.650798 --- ParallelTerminationStrategy: PID 20556 died... 00:49:58.670087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20556): Terminated: ok {rc=0} 00:49:58.714148 --- ParallelTerminationStrategy: PID 20559 died... 00:49:58.732770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20559): Terminated: ok {rc=0} 00:49:58.776933 --- ParallelTerminationStrategy: PID 20562 died... 00:49:58.795683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20562): Terminated: ok {rc=0} 00:49:58.881599 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 00:49:59.968932 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:49:59.981789 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:50:00.042290 tst ping_idle_ping.py: using LAC 37391 00:50:00.170379 tst ping_idle_ping.py: using RAC 161 00:50:00.298701 tst ping_idle_ping.py: using CellId 37391 00:50:00.425761 tst ping_idle_ping.py: using BVCI 37392 00:50:00.536185 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:00.547448 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:00.558592 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:00.569540 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:00.580898 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:00.592251 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:00.603859 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:50:00.615356 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:50:00.735319 tst ping_idle_ping.py:24: start network... 00:50:00.963666 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:50:01.476907 run create_hlr_db(pid=20564): Launched 00:50:01.644851 bus /gobi_6: Setting Powered False 00:50:02.709809 run create_hlr_db(pid=20564): Terminated: ok {rc=0} 00:50:03.154757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20569): Launched 00:50:03.457673 run osmo-hlr_10.42.42.2(pid=20570): Launched 00:50:03.574059 run osmo-stp_10.42.42.5: Starting osmo-stp 00:50:04.095645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20572): Launched 00:50:04.400832 run osmo-stp_10.42.42.5(pid=20573): Launched 00:50:04.516265 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:50:05.038732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20575): Launched 00:50:05.154590 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:50:05.410380 run patchelf(pid=20576): Launched 00:50:05.581209 run osmo-stp_10.42.42.5(pid=20573): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20573)] 00:50:05.709222 run osmo-stp_10.42.42.5(pid=20573): stdout: | (launched: 2022-12-14_00:50:04.344444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:05.838811 run osmo-stp_10.42.42.5(pid=20573): stderr: | [0;m[38;5;43m20221214005004513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005004513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005004513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005004514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005004514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005004514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005004514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:05.968725 run osmo-stp_10.42.42.5(pid=20573): stdout: | (launched: 2022-12-14_00:50:04.344444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:06.092884 run osmo-stp_10.42.42.5(pid=20573): stderr: | [0;m[38;5;43m20221214005004513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005004513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005004513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005004514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005004514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005004514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005004514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:06.239258 run patchelf(pid=20576): Terminating (SIGINT) 00:50:06.407873 run patchelf(pid=20576): Terminated: ok {rc=0} 00:50:06.529428 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20573): Process ended prematurely: osmo-stp_10.42.42.5(pid=20573) [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20573)] [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 00:50:06.538363 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 00:50:06.565229 run osmo-hlr_10.42.42.2(pid=20570): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20570)] 00:50:06.612919 run osmo-hlr_10.42.42.2(pid=20570): stdout: | (launched: 2022-12-14_00:50:03.401309) 00:50:06.662513 run osmo-hlr_10.42.42.2(pid=20570): stderr: | [0;m[1;31m20221214005003575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005003575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005003575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005003576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005003576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005003576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005003590 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005003600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005003601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005003601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:50:06.712569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20569): Terminating (SIGTERM) 00:50:06.752305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20572): Terminating (SIGTERM) 00:50:06.791921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20575): Terminating (SIGTERM) 00:50:06.832062 --- ParallelTerminationStrategy: PID 20569 died... 00:50:06.850772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20569): Terminated: ok {rc=0} 00:50:06.894757 --- ParallelTerminationStrategy: PID 20572 died... 00:50:06.913505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20572): Terminated: ok {rc=0} 00:50:06.957445 --- ParallelTerminationStrategy: PID 20575 died... 00:50:06.976183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20575): Terminated: ok {rc=0} 00:50:07.062979 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:50:08.361636 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:50:08.369088 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:50:08.390703 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 00:50:08.428322 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:50:08.485021 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:50:08.506419 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 00:50:08.541032 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:50:09.097623 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2397 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 00:50:09.102649 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:50:09.113903 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:50:09.172330 tst switch_tch_pdch.py: using LAC 37392 00:50:09.292890 tst switch_tch_pdch.py: using RAC 162 00:50:09.411329 tst switch_tch_pdch.py: using CellId 37392 00:50:09.531869 tst switch_tch_pdch.py: using BVCI 37393 00:50:09.644065 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:50:09.655321 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:50:09.666368 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:50:09.677371 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:50:09.688695 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:50:09.700154 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:50:09.711859 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:50:09.723338 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:50:09.844350 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:50:09.960856 tst switch_tch_pdch.py:51: start network... 00:50:10.161938 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:50:10.630257 run create_hlr_db(pid=20580): Launched 00:50:10.754672 bus /gobi_6: Setting Powered False 00:50:11.814801 run create_hlr_db(pid=20580): Terminated: ok {rc=0} 00:50:12.259831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20582): Launched 00:50:12.586800 run osmo-hlr_10.42.42.2(pid=20583): Launched 00:50:12.713337 run osmo-stp_10.42.42.5: Starting osmo-stp 00:50:13.274073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20585): Launched 00:50:13.598855 run osmo-stp_10.42.42.5(pid=20586): Launched 00:50:13.725359 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:50:14.283410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20588): Launched 00:50:14.409536 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:50:14.683457 run patchelf(pid=20589): Launched 00:50:14.865197 run osmo-stp_10.42.42.5(pid=20586): ERR: Terminated: ERROR {rc=1} [trial-2397↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20586)] 00:50:15.002285 run osmo-stp_10.42.42.5(pid=20586): stdout: | (launched: 2022-12-14_00:50:13.538777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:15.140713 run osmo-stp_10.42.42.5(pid=20586): stderr: | [0;m[38;5;43m20221214005013729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005013729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005013729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005013729 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005013730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005013730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005013730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:15.280032 run osmo-stp_10.42.42.5(pid=20586): stdout: | (launched: 2022-12-14_00:50:13.538777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:15.412336 run osmo-stp_10.42.42.5(pid=20586): stderr: | [0;m[38;5;43m20221214005013729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005013729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005013729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005013729 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005013730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005013730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005013730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:15.569441 run patchelf(pid=20589): Terminating (SIGINT) 00:50:15.750701 run patchelf(pid=20589): Terminated: ok {rc=0} 00:50:15.893763 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20586): Process ended prematurely: osmo-stp_10.42.42.5(pid=20586) [trial-2397↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20586)] [trial-2397↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 00:50:15.904809 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 00:50:15.938405 run osmo-hlr_10.42.42.2(pid=20583): ERR: Terminated: ERROR {rc=237} [trial-2397↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20583)] 00:50:15.993102 run osmo-hlr_10.42.42.2(pid=20583): stdout: | (launched: 2022-12-14_00:50:12.526696) 00:50:16.047546 run osmo-hlr_10.42.42.2(pid=20583): stderr: | [0;m[1;31m20221214005012723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005012723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005012723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005012723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005012723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005012723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005012735 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005012744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005012744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005012744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:50:16.103034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20582): Terminating (SIGTERM) 00:50:16.147274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20585): Terminating (SIGTERM) 00:50:16.194584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20588): Terminating (SIGTERM) 00:50:16.241226 --- ParallelTerminationStrategy: PID 20582 died... 00:50:16.263558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20582): Terminated: ok {rc=0} 00:50:16.312629 --- ParallelTerminationStrategy: PID 20585 died... 00:50:16.334676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20585): Terminated: ok {rc=0} 00:50:16.383579 --- ParallelTerminationStrategy: PID 20588 died... 00:50:16.405346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20588): Terminated: ok {rc=0} 00:50:16.497061 bus /gobi_0: Setting Powered False 00:50:17.596017 bus /gobi_0: Setting Powered False 00:50:18.710971 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 00:50:19.964679 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:50:19.971145 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 00:50:19.992465 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 00:50:20.030045 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 00:50:20.089134 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 00:50:20.111277 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 00:50:20.147417 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 00:50:20.698994 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2397 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 00:50:20.704308 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:20.715680 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 00:50:20.776078 tst switch_tch_pdch.py: using LAC 37393 00:50:20.904453 tst switch_tch_pdch.py: using RAC 163 00:50:21.030913 tst switch_tch_pdch.py: using CellId 37393 00:50:21.157289 tst switch_tch_pdch.py: using BVCI 37394 00:50:21.276144 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:21.287648 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:21.298967 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:21.310221 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:21.321707 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:21.333091 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:21.344857 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:50:21.356442 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:50:21.473930 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:50:21.589130 tst switch_tch_pdch.py:51: start network... 00:50:21.791449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:50:22.233371 run create_hlr_db(pid=20594): Launched 00:50:22.357414 bus /gobi_6: Setting Powered False 00:50:23.417500 run create_hlr_db(pid=20594): Terminated: ok {rc=0} 00:50:23.833926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20596): Launched 00:50:24.158205 run osmo-hlr_10.42.42.2(pid=20597): Launched 00:50:24.283813 run osmo-stp_10.42.42.5: Starting osmo-stp 00:50:24.816782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20599): Launched 00:50:25.144014 run osmo-stp_10.42.42.5(pid=20600): Launched 00:50:25.268821 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:50:25.801546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20602): Launched 00:50:25.928242 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:50:26.203146 run patchelf(pid=20603): Launched 00:50:26.385497 run osmo-stp_10.42.42.5(pid=20600): ERR: Terminated: ERROR {rc=1} [trial-2397↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20600)] 00:50:26.522748 run osmo-stp_10.42.42.5(pid=20600): stdout: | (launched: 2022-12-14_00:50:25.083906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:26.662024 run osmo-stp_10.42.42.5(pid=20600): stderr: | [0;m[38;5;43m20221214005025276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005025276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005025276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005025277 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005025277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005025277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005025277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:26.801054 run osmo-stp_10.42.42.5(pid=20600): stdout: | (launched: 2022-12-14_00:50:25.083906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:26.933370 run osmo-stp_10.42.42.5(pid=20600): stderr: | [0;m[38;5;43m20221214005025276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005025276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005025276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005025277 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005025277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005025277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005025277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:27.090965 run patchelf(pid=20603): Terminating (SIGINT) 00:50:27.272217 run patchelf(pid=20603): Terminated: ok {rc=0} 00:50:27.402551 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20600): Process ended prematurely: osmo-stp_10.42.42.5(pid=20600) [trial-2397↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20600)] [trial-2397↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 00:50:27.412161 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 00:50:27.440493 run osmo-hlr_10.42.42.2(pid=20597): ERR: Terminated: ERROR {rc=237} [trial-2397↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20597)] 00:50:27.491651 run osmo-hlr_10.42.42.2(pid=20597): stdout: | (launched: 2022-12-14_00:50:24.098633) 00:50:27.544662 run osmo-hlr_10.42.42.2(pid=20597): stderr: | [0;m[1;31m20221214005024296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005024297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005024297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005024297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005024297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005024297 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005024309 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005024317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005024317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005024317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:50:27.597625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20596): Terminating (SIGTERM) 00:50:27.639986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20599): Terminating (SIGTERM) 00:50:27.682418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20602): Terminating (SIGTERM) 00:50:27.725314 --- ParallelTerminationStrategy: PID 20596 died... 00:50:27.746224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20596): Terminated: ok {rc=0} 00:50:27.793326 --- ParallelTerminationStrategy: PID 20599 died... 00:50:27.813527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20599): Terminated: ok {rc=0} 00:50:27.860362 --- ParallelTerminationStrategy: PID 20602 died... 00:50:27.880592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20602): Terminated: ok {rc=0} 00:50:27.969090 bus /gobi_0: Setting Powered False 00:50:29.068870 bus /gobi_0: Setting Powered False 00:50:30.185846 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 nitb_sms:oc2g --------------------------------------------------------------------- 00:50:31.470025 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:50:31.474999 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 00:50:31.497431 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 00:50:31.505468 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 00:50:31.563425 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 00:50:31.594781 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 00:50:31.605468 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 00:50:32.129413 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 00:50:32.136332 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 00:50:32.151505 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 00:50:32.198067 tst mo_mt_sms.py: using LAC 37394 00:50:32.320865 tst mo_mt_sms.py: using RAC 164 00:50:32.440658 tst mo_mt_sms.py: using CellId 37394 00:50:32.561863 tst mo_mt_sms.py: using BVCI 37395 00:50:32.672724 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 00:50:32.793174 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 00:50:32.908178 tst mo_mt_sms.py:9: start nitb and bts... 00:50:33.111000 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:50:33.727807 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20608): Launched 00:50:34.033401 run osmo-nitb_10.42.42.2(pid=20609): Launched 00:50:34.201366 run osmo-nitb_10.42.42.2(pid=20609): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20609)] 00:50:34.337231 run osmo-nitb_10.42.42.2(pid=20609): stdout: | (launched: 2022-12-14_00:50:33.976869) 00:50:34.474213 run osmo-nitb_10.42.42.2(pid=20609): stderr: | (launched: 2022-12-14_00:50:34.021857) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:50:34.611104 run osmo-nitb_10.42.42.2(pid=20609): stdout: | (launched: 2022-12-14_00:50:33.976869) 00:50:34.741883 run osmo-nitb_10.42.42.2(pid=20609): stderr: | (launched: 2022-12-14_00:50:34.021857) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8b7301f268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20609): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20609) [trial-2397↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20609)] 00:50:35.147611 tst osmo-nitb_10.42.42.2(pid=20609): stdout: | (launched: 2022-12-14_00:50:33.976869) 00:50:35.269797 tst osmo-nitb_10.42.42.2(pid=20609): stderr: | (launched: 2022-12-14_00:50:34.021857) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:50:35.413098 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=20609): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20609) [trial-2397↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20609)] [trial-2397↪nitb_sms:oc2g↪mo_mt_sms.py:11] 00:50:35.421513 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 00:50:35.428227 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20608): Terminating (SIGTERM) 00:50:35.636221 --- ParallelTerminationStrategy: PID 20608 died... 00:50:35.656456 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20608): Terminated: ok {rc=0} 00:50:35.743348 bus /sierra_3: Setting Powered False 00:50:36.843699 bus /sierra_3: Setting Powered False 00:50:37.959785 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 sms:oc2g --------------------------------------------------------------------- 00:50:39.141308 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:50:39.145383 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 00:50:39.165850 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 00:50:39.192562 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 00:50:39.244164 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 00:50:39.264941 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 00:50:39.292153 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 00:50:39.838220 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 sms:oc2g mo_mt_sms.py ---------------------------------------------- 00:50:39.843402 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 00:50:39.854146 tst sms:oc2g: Using 1 x bts (candidates: 1) 00:50:39.888261 tst mo_mt_sms.py: using LAC 37395 00:50:40.016826 tst mo_mt_sms.py: using RAC 165 00:50:40.144052 tst mo_mt_sms.py: using CellId 37395 00:50:40.271127 tst mo_mt_sms.py: using BVCI 37396 00:50:40.388438 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 00:50:40.399483 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 00:50:40.410424 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 00:50:40.421411 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 00:50:40.432855 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 00:50:40.444082 tst sms:oc2g: Using 1 x modem (candidates: 2) 00:50:40.560202 tst sms:oc2g: Using 1 x modem (candidates: 2) 00:50:40.679372 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:50:41.147160 run create_hlr_db(pid=20613): Launched 00:50:41.272793 bus /sierra_2: Setting Powered False 00:50:42.333785 run create_hlr_db(pid=20613): Terminated: ok {rc=0} 00:50:42.778641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20615): Launched 00:50:43.104817 run osmo-hlr_10.42.42.2(pid=20616): Launched 00:50:43.230961 run osmo-stp_10.42.42.5: Starting osmo-stp 00:50:43.792926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20618): Launched 00:50:44.119723 run osmo-stp_10.42.42.5(pid=20619): Launched 00:50:44.243787 run osmo-msc_10.42.42.6: Starting osmo-msc 00:50:44.830405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20621): Launched 00:50:45.155262 run osmo-msc_10.42.42.6(pid=20622): Launched 00:50:45.338718 run osmo-stp_10.42.42.5(pid=20619): ERR: Terminated: ERROR {rc=1} [trial-2397↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20619)] 00:50:45.475047 run osmo-stp_10.42.42.5(pid=20619): stdout: | (launched: 2022-12-14_00:50:44.059622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:45.612065 run osmo-stp_10.42.42.5(pid=20619): stderr: | [0;m[38;5;43m20221214005044249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005044249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005044249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005044250 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005044250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005044250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005044250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:45.747363 run osmo-stp_10.42.42.5(pid=20619): stdout: | (launched: 2022-12-14_00:50:44.059622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:50:45.905162 run osmo-stp_10.42.42.5(pid=20619): stderr: | [0;m[38;5;43m20221214005044249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005044249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005044249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005044250 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005044250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005044250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005044250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:50:46.078579 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=20619): Process ended prematurely: osmo-stp_10.42.42.5(pid=20619) [trial-2397↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20619)] [trial-2397↪sms:oc2g↪mo_mt_sms.py:16] 00:50:46.088781 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 00:50:46.117863 run osmo-hlr_10.42.42.2(pid=20616): ERR: Terminated: ERROR {rc=237} [trial-2397↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20616)] 00:50:46.172780 run osmo-hlr_10.42.42.2(pid=20616): stdout: | (launched: 2022-12-14_00:50:43.044891) 00:50:46.227974 run osmo-hlr_10.42.42.2(pid=20616): stderr: | [0;m[1;31m20221214005043242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005043242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005043242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005043242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005043242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005043242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005043258 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005043266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005043266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005043266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:50:46.304098 run osmo-msc_10.42.42.6(pid=20622): ERR: Terminated: ERROR {rc=2} [trial-2397↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20622)] 00:50:46.361484 run osmo-msc_10.42.42.6(pid=20622): stdout: | (launched: 2022-12-14_00:50:45.095262) 00:50:46.423813 run osmo-msc_10.42.42.6(pid=20622): stderr: | [0;m[38;5;43m20221214005045414 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005045415 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe186f43c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005045415 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005045415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005045415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005045415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005045417 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005045417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005045417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005045417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:50:46.485698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20615): Terminating (SIGTERM) 00:50:46.534675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20618): Terminating (SIGTERM) 00:50:46.587609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20621): Terminating (SIGTERM) 00:50:46.641793 --- ParallelTerminationStrategy: PID 20615 died... 00:50:46.666755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20615): Terminated: ok {rc=0} 00:50:46.722600 --- ParallelTerminationStrategy: PID 20618 died... 00:50:46.746774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20618): Terminated: ok {rc=0} 00:50:46.802714 --- ParallelTerminationStrategy: PID 20621 died... 00:50:46.827590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20621): Terminated: ok {rc=0} 00:50:46.931566 bus /sierra_3: Setting Powered False 00:50:48.042132 bus /sierra_3: Setting Powered False 00:50:49.159219 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 nitb_ussd:oc2g --------------------------------------------------------------------- 00:50:50.373393 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:50:50.377172 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 00:50:50.397504 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 00:50:50.404238 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 00:50:50.438835 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 00:50:50.459220 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 00:50:50.466067 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 00:50:50.988574 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2397 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 00:50:50.993890 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 00:50:51.004900 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 00:50:51.039917 tst assert_extension.py: using LAC 37396 00:50:51.159268 tst assert_extension.py: using RAC 166 00:50:51.280008 tst assert_extension.py: using CellId 37396 00:50:51.399892 tst assert_extension.py: using BVCI 37397 00:50:51.510318 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 00:50:51.630288 tst assert_extension.py:10: start nitb and bts... 00:50:51.833101 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:50:52.495473 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20629): Launched 00:50:52.822281 run osmo-nitb_10.42.42.2(pid=20630): Launched 00:50:53.004468 run osmo-nitb_10.42.42.2(pid=20630): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20630)] 00:50:53.149949 run osmo-nitb_10.42.42.2(pid=20630): stdout: | (launched: 2022-12-14_00:50:52.762037) 00:50:53.297430 run osmo-nitb_10.42.42.2(pid=20630): stderr: | (launched: 2022-12-14_00:50:52.810078) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:50:53.444628 run osmo-nitb_10.42.42.2(pid=20630): stdout: | (launched: 2022-12-14_00:50:52.762037) 00:50:53.585608 run osmo-nitb_10.42.42.2(pid=20630): stderr: | (launched: 2022-12-14_00:50:52.810078) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8b7301f268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20630): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20630) [trial-2397↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20630)] 00:50:53.947418 tst osmo-nitb_10.42.42.2(pid=20630): stdout: | (launched: 2022-12-14_00:50:52.762037) 00:50:54.069223 tst osmo-nitb_10.42.42.2(pid=20630): stderr: | (launched: 2022-12-14_00:50:52.810078) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:50:54.212024 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=20630): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20630) [trial-2397↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20630)] [trial-2397↪nitb_ussd:oc2g↪assert_extension.py:12] 00:50:54.220382 tst assert_extension.py:12: Test FAILED (3.2 sec) 00:50:54.227588 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20629): Terminating (SIGTERM) 00:50:54.437275 --- ParallelTerminationStrategy: PID 20629 died... 00:50:54.457880 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20629): Terminated: ok {rc=0} 00:50:54.541486 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 ussd:oc2g --------------------------------------------------------------------- 00:50:55.707787 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:50:55.712861 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 00:50:55.735721 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 00:50:55.764112 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 00:50:55.801422 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 00:50:55.822753 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 00:50:55.850222 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 00:50:56.377812 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2397 ussd:oc2g assert_extension.py ---------------------------------------------- 00:50:56.383055 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 00:50:56.394091 tst ussd:oc2g: Using 1 x bts (candidates: 1) 00:50:56.428825 tst assert_extension.py: using LAC 37397 00:50:56.555927 tst assert_extension.py: using RAC 167 00:50:56.683091 tst assert_extension.py: using CellId 37397 00:50:56.814759 tst assert_extension.py: using BVCI 37398 00:50:56.933778 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 00:50:56.944902 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 00:50:56.956059 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 00:50:56.967109 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 00:50:56.978607 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 00:50:56.989969 tst ussd:oc2g: Using 1 x modem (candidates: 1) 00:50:57.105729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:50:57.572519 run create_hlr_db(pid=20634): Launched 00:50:57.696942 bus /sierra_2: Setting Powered False 00:50:58.761340 run create_hlr_db(pid=20634): Terminated: ok {rc=0} 00:50:59.213657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20636): Launched 00:50:59.541513 run osmo-hlr_10.42.42.2(pid=20637): Launched 00:50:59.667877 run osmo-stp_10.42.42.5: Starting osmo-stp 00:51:00.238510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20639): Launched 00:51:00.565421 run osmo-stp_10.42.42.5(pid=20640): Launched 00:51:00.690932 run osmo-msc_10.42.42.6: Starting osmo-msc 00:51:01.295442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20642): Launched 00:51:01.618838 run osmo-msc_10.42.42.6(pid=20643): Launched 00:51:02.081312 run osmo-stp_10.42.42.5(pid=20640): ERR: Terminated: ERROR {rc=1} [trial-2397↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20640)] 00:51:02.420247 run osmo-stp_10.42.42.5(pid=20640): stdout: | (launched: 2022-12-14_00:51:00.505189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:02.582936 run osmo-stp_10.42.42.5(pid=20640): stderr: | [0;m[38;5;43m20221214005100699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005100699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005100699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005100699 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005100700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005100700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005100700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:02.718044 run osmo-stp_10.42.42.5(pid=20640): stdout: | (launched: 2022-12-14_00:51:00.505189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:02.847146 run osmo-stp_10.42.42.5(pid=20640): stderr: | [0;m[38;5;43m20221214005100699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005100699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005100699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005100699 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005100700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005100700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005100700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:03.002097 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=20640): Process ended prematurely: osmo-stp_10.42.42.5(pid=20640) [trial-2397↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20640)] [trial-2397↪ussd:oc2g↪assert_extension.py:17] 00:51:03.011404 tst assert_extension.py:17: Test FAILED (6.6 sec) 00:51:03.039532 run osmo-hlr_10.42.42.2(pid=20637): ERR: Terminated: ERROR {rc=237} [trial-2397↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20637)] 00:51:03.091032 run osmo-hlr_10.42.42.2(pid=20637): stdout: | (launched: 2022-12-14_00:50:59.481378) 00:51:03.143602 run osmo-hlr_10.42.42.2(pid=20637): stderr: | [0;m[1;31m20221214005059680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005059680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005059680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005059680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005059680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005059680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005059692 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005059700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005059701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005059701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:51:03.217287 run osmo-msc_10.42.42.6(pid=20643): ERR: Terminated: ERROR {rc=2} [trial-2397↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20643)] 00:51:03.268017 run osmo-msc_10.42.42.6(pid=20643): stdout: | (launched: 2022-12-14_00:51:01.559954) 00:51:03.320378 run osmo-msc_10.42.42.6(pid=20643): stderr: | [0;m[38;5;43m20221214005102273 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005102274 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7d37946c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005102274 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005102274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005102274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005102274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005102276 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005102276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005102276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005102276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:51:03.373677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20636): Terminating (SIGTERM) 00:51:03.415867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20639): Terminating (SIGTERM) 00:51:03.458732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20642): Terminating (SIGTERM) 00:51:03.501769 --- ParallelTerminationStrategy: PID 20636 died... 00:51:03.522282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20636): Terminated: ok {rc=0} 00:51:03.569040 --- ParallelTerminationStrategy: PID 20639 died... 00:51:03.589145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20639): Terminated: ok {rc=0} 00:51:03.635829 --- ParallelTerminationStrategy: PID 20642 died... 00:51:03.655886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20642): Terminated: ok {rc=0} 00:51:03.744501 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 00:51:04.938322 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:51:04.945955 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 00:51:04.966375 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 00:51:04.993322 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 00:51:05.044929 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 00:51:05.066013 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 00:51:05.092394 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 00:51:05.645309 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 00:51:05.699928 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:05.711428 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:51:05.769074 tst mo_mt_call.py: using LAC 37398 00:51:05.902203 tst mo_mt_call.py: using RAC 168 00:51:06.030543 tst mo_mt_call.py: using CellId 37398 00:51:06.161452 tst mo_mt_call.py: using BVCI 37399 00:51:06.282006 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:06.293646 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:06.304877 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:06.316345 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:06.328045 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:06.339724 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:51:06.458191 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:51:06.577592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:51:07.089574 run create_hlr_db(pid=20649): Launched 00:51:07.216401 bus /sierra_2: Setting Powered False 00:51:08.281525 run create_hlr_db(pid=20649): Terminated: ok {rc=0} 00:51:08.722075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20651): Launched 00:51:09.030847 run osmo-hlr_10.42.42.2(pid=20652): Launched 00:51:09.147754 run osmo-stp_10.42.42.5: Starting osmo-stp 00:51:09.695032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20654): Launched 00:51:10.004613 run osmo-stp_10.42.42.5(pid=20655): Launched 00:51:10.122075 run osmo-msc_10.42.42.6: Starting osmo-msc 00:51:10.683214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20657): Launched 00:51:10.993884 run osmo-msc_10.42.42.6(pid=20658): Launched 00:51:11.166818 run osmo-stp_10.42.42.5(pid=20655): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20655)] 00:51:11.296217 run osmo-stp_10.42.42.5(pid=20655): stdout: | (launched: 2022-12-14_00:51:09.947257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:11.425383 run osmo-stp_10.42.42.5(pid=20655): stderr: | [0;m[38;5;43m20221214005110117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005110117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005110117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005110118 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005110118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005110118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005110118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:11.552942 run osmo-stp_10.42.42.5(pid=20655): stdout: | (launched: 2022-12-14_00:51:09.947257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:11.674366 run osmo-stp_10.42.42.5(pid=20655): stderr: | [0;m[38;5;43m20221214005110117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005110117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005110117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005110118 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005110118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005110118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005110118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:11.820390 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20655): Process ended prematurely: osmo-stp_10.42.42.5(pid=20655) [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20655)] [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 00:51:11.829385 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:51:11.855666 run osmo-hlr_10.42.42.2(pid=20652): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20652)] 00:51:11.903017 run osmo-hlr_10.42.42.2(pid=20652): stdout: | (launched: 2022-12-14_00:51:08.973570) 00:51:11.951865 run osmo-hlr_10.42.42.2(pid=20652): stderr: | [0;m[1;31m20221214005109147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005109147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005109147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005109147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005109147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005109148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005109160 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005109170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005109170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005109170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:51:12.020196 run osmo-msc_10.42.42.6(pid=20658): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20658)] 00:51:12.068061 run osmo-msc_10.42.42.6(pid=20658): stdout: | (launched: 2022-12-14_00:51:10.936463) 00:51:12.116854 run osmo-msc_10.42.42.6(pid=20658): stderr: | [0;m[38;5;43m20221214005111207 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005111208 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f086499cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005111208 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005111208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005111208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005111208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005111210 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005111210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005111211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005111211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:51:12.166326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20651): Terminating (SIGTERM) 00:51:12.205430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20654): Terminating (SIGTERM) 00:51:12.244677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20657): Terminating (SIGTERM) 00:51:12.284207 --- ParallelTerminationStrategy: PID 20651 died... 00:51:12.303251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20651): Terminated: ok {rc=0} 00:51:12.346896 --- ParallelTerminationStrategy: PID 20654 died... 00:51:12.365459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20654): Terminated: ok {rc=0} 00:51:12.408864 --- ParallelTerminationStrategy: PID 20657 died... 00:51:12.427939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20657): Terminated: ok {rc=0} 00:51:12.511510 bus /sierra_3: Setting Powered False 00:51:13.609692 bus /sierra_3: Setting Powered False 00:51:14.726693 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 00:51:15.877993 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:15.890126 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:51:15.952170 tst mo_mt_call_osmux.py: using LAC 37399 00:51:16.089761 tst mo_mt_call_osmux.py: using RAC 169 00:51:16.215683 tst mo_mt_call_osmux.py: using CellId 37399 00:51:16.347482 tst mo_mt_call_osmux.py: using BVCI 37400 00:51:16.470668 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:16.483242 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:16.495676 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:16.508551 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:16.522362 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:51:16.535965 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:51:16.663706 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:51:16.802298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:51:17.326278 run create_hlr_db(pid=20660): Launched 00:51:17.469830 bus /sierra_2: Setting Powered False 00:51:18.534435 run create_hlr_db(pid=20660): Terminated: ok {rc=0} 00:51:18.994278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20662): Launched 00:51:19.325916 run osmo-hlr_10.42.42.2(pid=20663): Launched 00:51:19.452331 run osmo-stp_10.42.42.5: Starting osmo-stp 00:51:20.022178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20665): Launched 00:51:20.336289 run osmo-stp_10.42.42.5(pid=20666): Launched 00:51:20.453285 run osmo-msc_10.42.42.6: Starting osmo-msc 00:51:21.007523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20668): Launched 00:51:21.317697 run osmo-msc_10.42.42.6(pid=20669): Launched 00:51:21.491307 run osmo-stp_10.42.42.5(pid=20666): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20666)] 00:51:21.621643 run osmo-stp_10.42.42.5(pid=20666): stdout: | (launched: 2022-12-14_00:51:20.279079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:21.751221 run osmo-stp_10.42.42.5(pid=20666): stderr: | [0;m[38;5;43m20221214005120449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005120449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005120449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005120450 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005120450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005120450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005120450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:21.878907 run osmo-stp_10.42.42.5(pid=20666): stdout: | (launched: 2022-12-14_00:51:20.279079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:22.000808 run osmo-stp_10.42.42.5(pid=20666): stderr: | [0;m[38;5;43m20221214005120449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005120449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005120449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005120450 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005120450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005120450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005120450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:22.148510 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20666): Process ended prematurely: osmo-stp_10.42.42.5(pid=20666) [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20666)] [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 00:51:22.157545 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 00:51:22.184096 run osmo-hlr_10.42.42.2(pid=20663): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20663)] 00:51:22.231822 run osmo-hlr_10.42.42.2(pid=20663): stdout: | (launched: 2022-12-14_00:51:19.264749) 00:51:22.280842 run osmo-hlr_10.42.42.2(pid=20663): stderr: | [0;m[1;31m20221214005119462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005119462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005119462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005119462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005119463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005119463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005119475 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005119483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005119484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005119484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:51:22.349661 run osmo-msc_10.42.42.6(pid=20669): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20669)] 00:51:22.397135 run osmo-msc_10.42.42.6(pid=20669): stdout: | (launched: 2022-12-14_00:51:21.260356) 00:51:22.446088 run osmo-msc_10.42.42.6(pid=20669): stderr: | [0;m[38;5;43m20221214005121531 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005121531 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffab355bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005121531 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005121531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005121532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005121532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005121533 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005121534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005121534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005121534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:51:22.495547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20662): Terminating (SIGTERM) 00:51:22.534951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20665): Terminating (SIGTERM) 00:51:22.574273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20668): Terminating (SIGTERM) 00:51:22.613983 --- ParallelTerminationStrategy: PID 20662 died... 00:51:22.633154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20662): Terminated: ok {rc=0} 00:51:22.676646 --- ParallelTerminationStrategy: PID 20665 died... 00:51:22.695147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20665): Terminated: ok {rc=0} 00:51:22.738387 --- ParallelTerminationStrategy: PID 20668 died... 00:51:22.756772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20668): Terminated: ok {rc=0} 00:51:22.839504 bus /sierra_3: Setting Powered False 00:51:23.936795 bus /sierra_3: Setting Powered False 00:51:25.053923 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 00:51:26.289207 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:51:26.295622 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 00:51:26.315993 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 00:51:26.343613 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 00:51:26.394466 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 00:51:26.415390 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 00:51:26.442139 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 00:51:26.995570 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 00:51:27.050671 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:27.062478 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:51:27.119613 tst mo_mt_call.py: using LAC 37400 00:51:27.247881 tst mo_mt_call.py: using RAC 170 00:51:27.375396 tst mo_mt_call.py: using CellId 37400 00:51:27.503468 tst mo_mt_call.py: using BVCI 37401 00:51:27.623501 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:27.635158 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:27.646608 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:27.657951 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:27.669800 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:27.681151 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:51:27.800750 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:51:27.918862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:51:28.400555 run create_hlr_db(pid=20674): Launched 00:51:28.527710 bus /sierra_2: Setting Powered False 00:51:29.589677 run create_hlr_db(pid=20674): Terminated: ok {rc=0} 00:51:30.042313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20676): Launched 00:51:30.376068 run osmo-hlr_10.42.42.2(pid=20677): Launched 00:51:30.502219 run osmo-stp_10.42.42.5: Starting osmo-stp 00:51:31.099006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20679): Launched 00:51:31.448353 run osmo-stp_10.42.42.5(pid=20680): Launched 00:51:31.740872 run osmo-msc_10.42.42.6: Starting osmo-msc 00:51:32.478555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20682): Launched 00:51:32.812241 run osmo-msc_10.42.42.6(pid=20683): Launched 00:51:32.997771 run osmo-stp_10.42.42.5(pid=20680): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20680)] 00:51:33.140487 run osmo-stp_10.42.42.5(pid=20680): stdout: | (launched: 2022-12-14_00:51:31.384501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:33.280672 run osmo-stp_10.42.42.5(pid=20680): stderr: | [0;m[38;5;43m20221214005131666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005131666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005131667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005131669 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005131670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005131670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005131670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:33.419351 run osmo-stp_10.42.42.5(pid=20680): stdout: | (launched: 2022-12-14_00:51:31.384501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:33.550759 run osmo-stp_10.42.42.5(pid=20680): stderr: | [0;m[38;5;43m20221214005131666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005131666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005131667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005131669 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005131670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005131670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005131670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:33.708444 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20680): Process ended prematurely: osmo-stp_10.42.42.5(pid=20680) [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20680)] [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 00:51:33.718097 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 00:51:33.745898 run osmo-hlr_10.42.42.2(pid=20677): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20677)] 00:51:33.797061 run osmo-hlr_10.42.42.2(pid=20677): stdout: | (launched: 2022-12-14_00:51:30.315008) 00:51:33.849420 run osmo-hlr_10.42.42.2(pid=20677): stderr: | [0;m[1;31m20221214005130512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005130512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005130513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005130513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005130513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005130513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005130528 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005130536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005130537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005130537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:51:33.921810 run osmo-msc_10.42.42.6(pid=20683): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20683)] 00:51:33.971898 run osmo-msc_10.42.42.6(pid=20683): stdout: | (launched: 2022-12-14_00:51:32.751224) 00:51:34.024082 run osmo-msc_10.42.42.6(pid=20683): stderr: | [0;m[38;5;43m20221214005133075 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005133075 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f140484fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005133075 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005133075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005133075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005133076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005133077 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005133078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005133078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005133078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:51:34.077064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20676): Terminating (SIGTERM) 00:51:34.118764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20679): Terminating (SIGTERM) 00:51:34.161403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20682): Terminating (SIGTERM) 00:51:34.203832 --- ParallelTerminationStrategy: PID 20676 died... 00:51:34.224903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20676): Terminated: ok {rc=0} 00:51:34.272270 --- ParallelTerminationStrategy: PID 20679 died... 00:51:34.292468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20679): Terminated: ok {rc=0} 00:51:34.339042 --- ParallelTerminationStrategy: PID 20682 died... 00:51:34.359148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20682): Terminated: ok {rc=0} 00:51:34.447818 bus /sierra_3: Setting Powered False 00:51:35.547226 bus /sierra_3: Setting Powered False 00:51:36.663669 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 00:51:37.814510 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:37.826766 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:51:37.885198 tst mo_mt_call_osmux.py: using LAC 37401 00:51:38.015374 tst mo_mt_call_osmux.py: using RAC 171 00:51:38.146046 tst mo_mt_call_osmux.py: using CellId 37401 00:51:38.275655 tst mo_mt_call_osmux.py: using BVCI 37402 00:51:38.397868 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:38.409374 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:38.420625 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:38.431936 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:38.443627 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:51:38.455241 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:51:38.576639 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:51:38.699530 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:51:39.177075 run create_hlr_db(pid=20685): Launched 00:51:39.302509 bus /sierra_2: Setting Powered False 00:51:40.363367 run create_hlr_db(pid=20685): Terminated: ok {rc=0} 00:51:40.812786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20687): Launched 00:51:41.145963 run osmo-hlr_10.42.42.2(pid=20688): Launched 00:51:41.274404 run osmo-stp_10.42.42.5: Starting osmo-stp 00:51:41.845689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20690): Launched 00:51:42.178274 run osmo-stp_10.42.42.5(pid=20691): Launched 00:51:42.305999 run osmo-msc_10.42.42.6: Starting osmo-msc 00:51:42.902377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20693): Launched 00:51:43.235234 run osmo-msc_10.42.42.6(pid=20694): Launched 00:51:43.420443 run osmo-stp_10.42.42.5(pid=20691): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20691)] 00:51:43.559518 run osmo-stp_10.42.42.5(pid=20691): stdout: | (launched: 2022-12-14_00:51:42.117453) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:43.699806 run osmo-stp_10.42.42.5(pid=20691): stderr: | [0;m[38;5;43m20221214005142310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005142311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005142311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005142311 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005142312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005142312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005142312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:43.837615 run osmo-stp_10.42.42.5(pid=20691): stdout: | (launched: 2022-12-14_00:51:42.117453) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:43.967876 run osmo-stp_10.42.42.5(pid=20691): stderr: | [0;m[38;5;43m20221214005142310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005142311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005142311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005142311 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005142312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005142312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005142312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:44.124761 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20691): Process ended prematurely: osmo-stp_10.42.42.5(pid=20691) [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20691)] [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 00:51:44.134523 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 00:51:44.162173 run osmo-hlr_10.42.42.2(pid=20688): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20688)] 00:51:44.212647 run osmo-hlr_10.42.42.2(pid=20688): stdout: | (launched: 2022-12-14_00:51:41.085246) 00:51:44.264595 run osmo-hlr_10.42.42.2(pid=20688): stderr: | [0;m[1;31m20221214005141284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005141284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005141284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005141284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005141284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005141284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005141296 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005141304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005141304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005141304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:51:44.337258 run osmo-msc_10.42.42.6(pid=20694): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20694)] 00:51:44.386753 run osmo-msc_10.42.42.6(pid=20694): stdout: | (launched: 2022-12-14_00:51:43.174113) 00:51:44.438351 run osmo-msc_10.42.42.6(pid=20694): stderr: | [0;m[38;5;43m20221214005143495 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005143495 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4b89637c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005143495 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005143495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005143495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005143495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005143497 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005143498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005143498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005143498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:51:44.490125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20687): Terminating (SIGTERM) 00:51:44.531954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20690): Terminating (SIGTERM) 00:51:44.574242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20693): Terminating (SIGTERM) 00:51:44.616787 --- ParallelTerminationStrategy: PID 20687 died... 00:51:44.637216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20687): Terminated: ok {rc=0} 00:51:44.683121 --- ParallelTerminationStrategy: PID 20690 died... 00:51:44.702844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20690): Terminated: ok {rc=0} 00:51:44.748772 --- ParallelTerminationStrategy: PID 20693 died... 00:51:44.768480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20693): Terminated: ok {rc=0} 00:51:44.856752 bus /sierra_3: Setting Powered False 00:51:45.955464 bus /sierra_3: Setting Powered False 00:51:47.080320 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 00:51:48.319978 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:51:48.327305 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 00:51:48.348259 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 00:51:48.375035 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 00:51:48.426351 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 00:51:48.448043 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 00:51:48.476242 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 00:51:49.029116 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 00:51:49.083269 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:49.094900 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:51:49.151776 tst mo_mt_call.py: using LAC 37402 00:51:49.279342 tst mo_mt_call.py: using RAC 172 00:51:49.407505 tst mo_mt_call.py: using CellId 37402 00:51:49.534719 tst mo_mt_call.py: using BVCI 37403 00:51:49.656272 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:49.668005 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:49.679419 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:49.690743 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:49.702548 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:49.714294 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:51:49.834631 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:51:49.955258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:51:50.467086 run create_hlr_db(pid=20699): Launched 00:51:50.593377 bus /sierra_2: Setting Powered False 00:51:51.658689 run create_hlr_db(pid=20699): Terminated: ok {rc=0} 00:51:52.100760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20701): Launched 00:51:52.409524 run osmo-hlr_10.42.42.2(pid=20702): Launched 00:51:52.527598 run osmo-stp_10.42.42.5: Starting osmo-stp 00:51:53.059664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20704): Launched 00:51:53.369649 run osmo-stp_10.42.42.5(pid=20705): Launched 00:51:53.487548 run osmo-msc_10.42.42.6: Starting osmo-msc 00:51:54.046458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20707): Launched 00:51:54.356756 run osmo-msc_10.42.42.6(pid=20708): Launched 00:51:54.531888 run osmo-stp_10.42.42.5(pid=20705): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20705)] 00:51:54.660866 run osmo-stp_10.42.42.5(pid=20705): stdout: | (launched: 2022-12-14_00:51:53.312282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:54.790018 run osmo-stp_10.42.42.5(pid=20705): stderr: | [0;m[38;5;43m20221214005153484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005153484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005153484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005153485 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005153485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005153485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005153485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:54.917671 run osmo-stp_10.42.42.5(pid=20705): stdout: | (launched: 2022-12-14_00:51:53.312282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:51:55.039474 run osmo-stp_10.42.42.5(pid=20705): stderr: | [0;m[38;5;43m20221214005153484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005153484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005153484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005153485 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005153485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005153485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005153485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:51:55.185318 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20705): Process ended prematurely: osmo-stp_10.42.42.5(pid=20705) [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20705)] [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 00:51:55.194305 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:51:55.221119 run osmo-hlr_10.42.42.2(pid=20702): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20702)] 00:51:55.269308 run osmo-hlr_10.42.42.2(pid=20702): stdout: | (launched: 2022-12-14_00:51:52.351531) 00:51:55.318559 run osmo-hlr_10.42.42.2(pid=20702): stderr: | [0;m[1;31m20221214005152527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005152527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005152527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005152527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005152527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005152527 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005152539 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005152549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005152549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005152549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:51:55.387160 run osmo-msc_10.42.42.6(pid=20708): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20708)] 00:51:55.434253 run osmo-msc_10.42.42.6(pid=20708): stdout: | (launched: 2022-12-14_00:51:54.299381) 00:51:55.483099 run osmo-msc_10.42.42.6(pid=20708): stderr: | [0;m[38;5;43m20221214005154570 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005154570 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2ed7802c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005154570 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005154570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005154570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005154571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005154572 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005154573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005154573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005154573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:51:55.532576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20701): Terminating (SIGTERM) 00:51:55.571924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20704): Terminating (SIGTERM) 00:51:55.611257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20707): Terminating (SIGTERM) 00:51:55.650852 --- ParallelTerminationStrategy: PID 20701 died... 00:51:55.670085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20701): Terminated: ok {rc=0} 00:51:55.713580 --- ParallelTerminationStrategy: PID 20704 died... 00:51:55.731807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20704): Terminated: ok {rc=0} 00:51:55.775424 --- ParallelTerminationStrategy: PID 20707 died... 00:51:55.794069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20707): Terminated: ok {rc=0} 00:51:55.879464 bus /sierra_3: Setting Powered False 00:51:56.977113 bus /sierra_3: Setting Powered False 00:51:58.090171 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 00:51:59.240820 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:59.253434 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:51:59.312105 tst mo_mt_call_osmux.py: using LAC 37403 00:51:59.440497 tst mo_mt_call_osmux.py: using RAC 173 00:51:59.571078 tst mo_mt_call_osmux.py: using CellId 37403 00:51:59.699819 tst mo_mt_call_osmux.py: using BVCI 37404 00:51:59.820013 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:59.831639 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:59.843160 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:59.854595 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:59.866267 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:51:59.877984 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:51:59.995259 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:52:00.116471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:52:00.630532 run create_hlr_db(pid=20710): Launched 00:52:00.758912 bus /sierra_2: Setting Powered False 00:52:01.823757 run create_hlr_db(pid=20710): Terminated: ok {rc=0} 00:52:02.279000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20712): Launched 00:52:02.594316 run osmo-hlr_10.42.42.2(pid=20713): Launched 00:52:02.713082 run osmo-stp_10.42.42.5: Starting osmo-stp 00:52:03.242285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20715): Launched 00:52:03.550989 run osmo-stp_10.42.42.5(pid=20716): Launched 00:52:03.669888 run osmo-msc_10.42.42.6: Starting osmo-msc 00:52:04.225067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20718): Launched 00:52:04.534448 run osmo-msc_10.42.42.6(pid=20719): Launched 00:52:04.707072 run osmo-stp_10.42.42.5(pid=20716): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20716)] 00:52:04.836370 run osmo-stp_10.42.42.5(pid=20716): stdout: | (launched: 2022-12-14_00:52:03.493548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:04.966237 run osmo-stp_10.42.42.5(pid=20716): stderr: | [0;m[38;5;43m20221214005203666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005203666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005203666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005203667 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005203667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005203667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005203667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:05.093954 run osmo-stp_10.42.42.5(pid=20716): stdout: | (launched: 2022-12-14_00:52:03.493548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:05.215654 run osmo-stp_10.42.42.5(pid=20716): stderr: | [0;m[38;5;43m20221214005203666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005203666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005203666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005203667 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005203667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005203667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005203667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:05.361368 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20716): Process ended prematurely: osmo-stp_10.42.42.5(pid=20716) [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20716)] [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 00:52:05.370376 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:52:05.397094 run osmo-hlr_10.42.42.2(pid=20713): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20713)] 00:52:05.444599 run osmo-hlr_10.42.42.2(pid=20713): stdout: | (launched: 2022-12-14_00:52:02.536574) 00:52:05.493979 run osmo-hlr_10.42.42.2(pid=20713): stderr: | [0;m[1;31m20221214005202714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005202714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005202714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005202714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005202714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005202714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005202730 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005202741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005202741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005202741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:52:05.563157 run osmo-msc_10.42.42.6(pid=20719): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20719)] 00:52:05.610483 run osmo-msc_10.42.42.6(pid=20719): stdout: | (launched: 2022-12-14_00:52:04.476592) 00:52:05.659582 run osmo-msc_10.42.42.6(pid=20719): stderr: | [0;m[38;5;43m20221214005204750 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005204750 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd69fcbcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005204750 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005204751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005204751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005204751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005204753 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005204753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005204753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005204753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:52:05.709276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20712): Terminating (SIGTERM) 00:52:05.748591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20715): Terminating (SIGTERM) 00:52:05.788006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20718): Terminating (SIGTERM) 00:52:05.827837 --- ParallelTerminationStrategy: PID 20712 died... 00:52:05.847201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20712): Terminated: ok {rc=0} 00:52:05.891060 --- ParallelTerminationStrategy: PID 20715 died... 00:52:05.909806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20715): Terminated: ok {rc=0} 00:52:05.953446 --- ParallelTerminationStrategy: PID 20718 died... 00:52:05.972167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20718): Terminated: ok {rc=0} 00:52:06.057982 bus /sierra_3: Setting Powered False 00:52:07.156431 bus /sierra_3: Setting Powered False 00:52:08.268815 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 00:52:09.504710 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:52:09.511979 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 00:52:09.533330 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 00:52:09.561654 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 00:52:09.616391 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 00:52:09.637924 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 00:52:09.665755 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 00:52:10.213128 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 00:52:10.262795 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:10.274076 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 00:52:10.330086 tst mo_mt_call.py: using LAC 37404 00:52:10.450289 tst mo_mt_call.py: using RAC 174 00:52:10.573575 tst mo_mt_call.py: using CellId 37404 00:52:10.694477 tst mo_mt_call.py: using BVCI 37405 00:52:10.806884 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:10.818123 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:10.829138 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:10.839845 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:10.850667 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:10.861537 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:52:10.982864 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:52:11.103498 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:52:11.580485 run create_hlr_db(pid=20724): Launched 00:52:11.709636 bus /sierra_2: Setting Powered False 00:52:12.770494 run create_hlr_db(pid=20724): Terminated: ok {rc=0} 00:52:13.223518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20726): Launched 00:52:13.556778 run osmo-hlr_10.42.42.2(pid=20727): Launched 00:52:13.685413 run osmo-stp_10.42.42.5: Starting osmo-stp 00:52:14.259266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20729): Launched 00:52:14.592803 run osmo-stp_10.42.42.5(pid=20730): Launched 00:52:14.720794 run osmo-msc_10.42.42.6: Starting osmo-msc 00:52:15.320068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20732): Launched 00:52:15.652438 run osmo-msc_10.42.42.6(pid=20733): Launched 00:52:15.867780 run osmo-stp_10.42.42.5(pid=20730): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20730)] 00:52:16.087853 run osmo-stp_10.42.42.5(pid=20730): stdout: | (launched: 2022-12-14_00:52:14.531568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:16.372528 run osmo-stp_10.42.42.5(pid=20730): stderr: | [0;m[38;5;43m20221214005214726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005214727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005214727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005214727 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005214728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005214728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005214728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:16.506709 run osmo-stp_10.42.42.5(pid=20730): stdout: | (launched: 2022-12-14_00:52:14.531568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:16.635584 run osmo-stp_10.42.42.5(pid=20730): stderr: | [0;m[38;5;43m20221214005214726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005214727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005214727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005214727 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005214728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005214728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005214728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:16.789578 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20730): Process ended prematurely: osmo-stp_10.42.42.5(pid=20730) [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20730)] [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 00:52:16.799717 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 00:52:16.827853 run osmo-hlr_10.42.42.2(pid=20727): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20727)] 00:52:16.881703 run osmo-hlr_10.42.42.2(pid=20727): stdout: | (launched: 2022-12-14_00:52:13.495751) 00:52:16.934077 run osmo-hlr_10.42.42.2(pid=20727): stderr: | [0;m[1;31m20221214005213697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005213697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005213697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005213697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005213697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005213697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005213711 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005213719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005213719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005213719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:52:17.006403 run osmo-msc_10.42.42.6(pid=20733): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20733)] 00:52:17.058846 run osmo-msc_10.42.42.6(pid=20733): stdout: | (launched: 2022-12-14_00:52:15.591457) 00:52:17.111043 run osmo-msc_10.42.42.6(pid=20733): stderr: | [0;m[38;5;43m20221214005215987 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005215987 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd56c469c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005215987 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005215987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005215987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005215987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005215990 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005215991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005215991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005215991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:52:17.163872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20726): Terminating (SIGTERM) 00:52:17.206618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20729): Terminating (SIGTERM) 00:52:17.251145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20732): Terminating (SIGTERM) 00:52:17.295794 --- ParallelTerminationStrategy: PID 20726 died... 00:52:17.316743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20726): Terminated: ok {rc=0} 00:52:17.362545 --- ParallelTerminationStrategy: PID 20729 died... 00:52:17.382000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20729): Terminated: ok {rc=0} 00:52:17.426530 --- ParallelTerminationStrategy: PID 20732 died... 00:52:17.445946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20732): Terminated: ok {rc=0} 00:52:17.533134 bus /sierra_3: Setting Powered False 00:52:18.633344 bus /sierra_3: Setting Powered False 00:52:19.750333 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 00:52:20.898252 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:20.910596 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 00:52:20.967274 tst mo_mt_call_osmux.py: using LAC 37405 00:52:21.087871 tst mo_mt_call_osmux.py: using RAC 175 00:52:21.209953 tst mo_mt_call_osmux.py: using CellId 37405 00:52:21.331612 tst mo_mt_call_osmux.py: using BVCI 37406 00:52:21.443715 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:21.454769 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:21.465663 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:21.476551 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:21.487417 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:52:21.498298 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:52:21.618948 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:52:21.735765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:52:22.216104 run create_hlr_db(pid=20735): Launched 00:52:22.343007 bus /sierra_2: Setting Powered False 00:52:23.404107 run create_hlr_db(pid=20735): Terminated: ok {rc=0} 00:52:23.835329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20737): Launched 00:52:24.146705 run osmo-hlr_10.42.42.2(pid=20738): Launched 00:52:24.265536 run osmo-stp_10.42.42.5: Starting osmo-stp 00:52:24.810356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20740): Launched 00:52:25.121322 run osmo-stp_10.42.42.5(pid=20741): Launched 00:52:25.240402 run osmo-msc_10.42.42.6: Starting osmo-msc 00:52:25.797951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20743): Launched 00:52:26.108724 run osmo-msc_10.42.42.6(pid=20744): Launched 00:52:26.282386 run osmo-stp_10.42.42.5(pid=20741): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20741)] 00:52:26.411305 run osmo-stp_10.42.42.5(pid=20741): stdout: | (launched: 2022-12-14_00:52:25.063719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:26.540550 run osmo-stp_10.42.42.5(pid=20741): stderr: | [0;m[38;5;43m20221214005225235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005225235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005225235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005225236 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005225236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005225236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005225237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:26.669577 run osmo-stp_10.42.42.5(pid=20741): stdout: | (launched: 2022-12-14_00:52:25.063719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:26.791787 run osmo-stp_10.42.42.5(pid=20741): stderr: | [0;m[38;5;43m20221214005225235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005225235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005225235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005225236 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005225236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005225236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005225237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:26.938365 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20741): Process ended prematurely: osmo-stp_10.42.42.5(pid=20741) [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20741)] [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 00:52:26.947564 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 00:52:26.974316 run osmo-hlr_10.42.42.2(pid=20738): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20738)] 00:52:27.022757 run osmo-hlr_10.42.42.2(pid=20738): stdout: | (launched: 2022-12-14_00:52:24.089483) 00:52:27.072534 run osmo-hlr_10.42.42.2(pid=20738): stderr: | [0;m[1;31m20221214005224264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005224265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005224265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005224265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005224265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005224265 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005224275 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005224283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005224284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005224284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:52:27.141946 run osmo-msc_10.42.42.6(pid=20744): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20744)] 00:52:27.189702 run osmo-msc_10.42.42.6(pid=20744): stdout: | (launched: 2022-12-14_00:52:26.051350) 00:52:27.238860 run osmo-msc_10.42.42.6(pid=20744): stderr: | [0;m[38;5;43m20221214005226323 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005226323 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1730532c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005226323 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005226323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005226324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005226324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005226326 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005226326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005226326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005226326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:52:27.288470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20737): Terminating (SIGTERM) 00:52:27.328528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20740): Terminating (SIGTERM) 00:52:27.368325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20743): Terminating (SIGTERM) 00:52:27.408595 --- ParallelTerminationStrategy: PID 20737 died... 00:52:27.428075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20737): Terminated: ok {rc=0} 00:52:27.472504 --- ParallelTerminationStrategy: PID 20740 died... 00:52:27.491450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20740): Terminated: ok {rc=0} 00:52:27.536093 --- ParallelTerminationStrategy: PID 20743 died... 00:52:27.555110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20743): Terminated: ok {rc=0} 00:52:27.642168 bus /sierra_3: Setting Powered False 00:52:28.740894 bus /sierra_3: Setting Powered False 00:52:29.854111 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 00:52:31.109653 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:52:31.116571 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 00:52:31.144043 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 00:52:31.172566 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 00:52:31.226161 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 00:52:31.254820 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 00:52:31.291555 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 00:52:31.845828 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 00:52:31.914098 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:31.926358 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:52:31.984514 tst mo_mt_call.py: using LAC 37406 00:52:32.148234 tst mo_mt_call.py: using RAC 176 00:52:32.275389 tst mo_mt_call.py: using CellId 37406 00:52:32.397116 tst mo_mt_call.py: using BVCI 37407 00:52:32.508369 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:32.519583 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:32.530684 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:32.541865 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:32.552839 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:32.563937 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:52:32.683956 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:52:32.800884 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:52:33.280572 run create_hlr_db(pid=20749): Launched 00:52:33.412782 bus /sierra_2: Setting Powered False 00:52:34.477215 run create_hlr_db(pid=20749): Terminated: ok {rc=0} 00:52:34.920199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20751): Launched 00:52:35.231337 run osmo-hlr_10.42.42.2(pid=20752): Launched 00:52:35.350418 run osmo-stp_10.42.42.5: Starting osmo-stp 00:52:35.898080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20754): Launched 00:52:36.209341 run osmo-stp_10.42.42.5(pid=20755): Launched 00:52:36.328411 run osmo-msc_10.42.42.6: Starting osmo-msc 00:52:36.888005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20757): Launched 00:52:37.199982 run osmo-msc_10.42.42.6(pid=20758): Launched 00:52:37.374125 run osmo-stp_10.42.42.5(pid=20755): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20755)] 00:52:37.504343 run osmo-stp_10.42.42.5(pid=20755): stdout: | (launched: 2022-12-14_00:52:36.151883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:37.635034 run osmo-stp_10.42.42.5(pid=20755): stderr: | [0;m[38;5;43m20221214005236322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005236322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005236322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005236322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005236323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005236323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005236323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:37.763159 run osmo-stp_10.42.42.5(pid=20755): stdout: | (launched: 2022-12-14_00:52:36.151883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:37.885489 run osmo-stp_10.42.42.5(pid=20755): stderr: | [0;m[38;5;43m20221214005236322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005236322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005236322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005236322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005236323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005236323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005236323 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:38.032080 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20755): Process ended prematurely: osmo-stp_10.42.42.5(pid=20755) [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20755)] [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 00:52:38.041316 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:52:38.067833 run osmo-hlr_10.42.42.2(pid=20752): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20752)] 00:52:38.115642 run osmo-hlr_10.42.42.2(pid=20752): stdout: | (launched: 2022-12-14_00:52:35.173874) 00:52:38.164807 run osmo-hlr_10.42.42.2(pid=20752): stderr: | [0;m[1;31m20221214005235349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005235349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005235349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005235349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005235350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005235350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005235362 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005235370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005235370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005235370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:52:38.233716 run osmo-msc_10.42.42.6(pid=20758): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20758)] 00:52:38.281518 run osmo-msc_10.42.42.6(pid=20758): stdout: | (launched: 2022-12-14_00:52:37.142502) 00:52:38.330546 run osmo-msc_10.42.42.6(pid=20758): stderr: | [0;m[38;5;43m20221214005237415 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005237416 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5a09220c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005237416 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005237416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005237416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005237416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005237418 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005237418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005237418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005237418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:52:38.379955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20751): Terminating (SIGTERM) 00:52:38.419532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20754): Terminating (SIGTERM) 00:52:38.459058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20757): Terminating (SIGTERM) 00:52:38.499067 --- ParallelTerminationStrategy: PID 20751 died... 00:52:38.518483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20751): Terminated: ok {rc=0} 00:52:38.562614 --- ParallelTerminationStrategy: PID 20754 died... 00:52:38.581343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20754): Terminated: ok {rc=0} 00:52:38.624738 --- ParallelTerminationStrategy: PID 20757 died... 00:52:38.643428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20757): Terminated: ok {rc=0} 00:52:38.729105 bus /sierra_3: Setting Powered False 00:52:39.828078 bus /sierra_3: Setting Powered False 00:52:40.944183 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 00:52:42.091141 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:42.103069 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:52:42.160605 tst mo_mt_call_osmux.py: using LAC 37407 00:52:42.282616 tst mo_mt_call_osmux.py: using RAC 177 00:52:42.403289 tst mo_mt_call_osmux.py: using CellId 37407 00:52:42.526940 tst mo_mt_call_osmux.py: using BVCI 37408 00:52:42.639836 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:42.650967 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:42.661910 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:42.672746 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:42.683803 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:52:42.694988 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:52:42.816263 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:52:42.932667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:52:43.414008 run create_hlr_db(pid=20760): Launched 00:52:43.543564 bus /sierra_2: Setting Powered False 00:52:44.605089 run create_hlr_db(pid=20760): Terminated: ok {rc=0} 00:52:45.058392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20762): Launched 00:52:45.392835 run osmo-hlr_10.42.42.2(pid=20763): Launched 00:52:45.520572 run osmo-stp_10.42.42.5: Starting osmo-stp 00:52:46.129756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20765): Launched 00:52:46.457941 run osmo-stp_10.42.42.5(pid=20766): Launched 00:52:46.702745 run osmo-msc_10.42.42.6: Starting osmo-msc 00:52:47.392313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20768): Launched 00:52:47.727142 run osmo-msc_10.42.42.6(pid=20769): Launched 00:52:47.912478 run osmo-stp_10.42.42.5(pid=20766): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20766)] 00:52:48.051865 run osmo-stp_10.42.42.5(pid=20766): stdout: | (launched: 2022-12-14_00:52:46.398090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:48.191890 run osmo-stp_10.42.42.5(pid=20766): stderr: | [0;m[38;5;43m20221214005246735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005246735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005246735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005246736 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005246736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005246736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005246736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:48.330861 run osmo-stp_10.42.42.5(pid=20766): stdout: | (launched: 2022-12-14_00:52:46.398090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:48.462448 run osmo-stp_10.42.42.5(pid=20766): stderr: | [0;m[38;5;43m20221214005246735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005246735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005246735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005246736 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005246736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005246736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005246736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:48.620270 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20766): Process ended prematurely: osmo-stp_10.42.42.5(pid=20766) [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20766)] [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 00:52:48.630014 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 00:52:48.657990 run osmo-hlr_10.42.42.2(pid=20763): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20763)] 00:52:48.708705 run osmo-hlr_10.42.42.2(pid=20763): stdout: | (launched: 2022-12-14_00:52:45.331467) 00:52:48.760938 run osmo-hlr_10.42.42.2(pid=20763): stderr: | [0;m[1;31m20221214005245529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005245529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005245529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005245529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005245529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005245529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005245542 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005245550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005245551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005245551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:52:48.834058 run osmo-msc_10.42.42.6(pid=20769): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20769)] 00:52:48.884155 run osmo-msc_10.42.42.6(pid=20769): stdout: | (launched: 2022-12-14_00:52:47.665769) 00:52:48.936281 run osmo-msc_10.42.42.6(pid=20769): stderr: | [0;m[38;5;43m20221214005247985 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005247985 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4f463d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005247985 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005247985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005247985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005247985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005247987 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005247987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005247988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005247988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:52:48.988856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20762): Terminating (SIGTERM) 00:52:49.031120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20765): Terminating (SIGTERM) 00:52:49.073602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20768): Terminating (SIGTERM) 00:52:49.116242 --- ParallelTerminationStrategy: PID 20762 died... 00:52:49.136828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20762): Terminated: ok {rc=0} 00:52:49.183251 --- ParallelTerminationStrategy: PID 20765 died... 00:52:49.203139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20765): Terminated: ok {rc=0} 00:52:49.249484 --- ParallelTerminationStrategy: PID 20768 died... 00:52:49.269679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20768): Terminated: ok {rc=0} 00:52:49.357630 bus /sierra_3: Setting Powered False 00:52:50.455918 bus /sierra_3: Setting Powered False 00:52:51.572451 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:52:52.808589 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:52:52.815236 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:52:52.835655 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 00:52:52.863080 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:52:52.915490 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:52:52.936255 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 00:52:52.962802 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:52:53.513973 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 00:52:53.563550 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:52:53.574847 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:52:53.631636 tst mo_mt_call.py: using LAC 37408 00:52:53.754455 tst mo_mt_call.py: using RAC 178 00:52:53.875312 tst mo_mt_call.py: using CellId 37408 00:52:53.997334 tst mo_mt_call.py: using BVCI 37409 00:52:54.109637 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:52:54.120703 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:52:54.131585 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:52:54.142479 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:52:54.153514 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:52:54.164596 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:52:54.282745 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:52:54.403731 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:52:54.917170 run create_hlr_db(pid=20774): Launched 00:52:55.044599 bus /sierra_2: Setting Powered False 00:52:56.109779 run create_hlr_db(pid=20774): Terminated: ok {rc=0} 00:52:56.550347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20776): Launched 00:52:56.860648 run osmo-hlr_10.42.42.2(pid=20777): Launched 00:52:56.978248 run osmo-stp_10.42.42.5: Starting osmo-stp 00:52:57.533151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20779): Launched 00:52:57.841414 run osmo-stp_10.42.42.5(pid=20780): Launched 00:52:57.959118 run osmo-msc_10.42.42.6: Starting osmo-msc 00:52:58.518104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20782): Launched 00:52:58.826586 run osmo-msc_10.42.42.6(pid=20783): Launched 00:52:59.002250 run osmo-stp_10.42.42.5(pid=20780): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20780)] 00:52:59.132302 run osmo-stp_10.42.42.5(pid=20780): stdout: | (launched: 2022-12-14_00:52:57.783907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:59.262641 run osmo-stp_10.42.42.5(pid=20780): stderr: | [0;m[38;5;43m20221214005257955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005257955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005257955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005257956 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005257956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005257956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005257956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:59.390262 run osmo-stp_10.42.42.5(pid=20780): stdout: | (launched: 2022-12-14_00:52:57.783907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:52:59.512269 run osmo-stp_10.42.42.5(pid=20780): stderr: | [0;m[38;5;43m20221214005257955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005257955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005257955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005257956 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005257956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005257956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005257956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:52:59.658247 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20780): Process ended prematurely: osmo-stp_10.42.42.5(pid=20780) [trial-2397↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20780)] [trial-2397↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 00:52:59.667346 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 00:52:59.694009 run osmo-hlr_10.42.42.2(pid=20777): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20777)] 00:52:59.741549 run osmo-hlr_10.42.42.2(pid=20777): stdout: | (launched: 2022-12-14_00:52:56.803440) 00:52:59.790861 run osmo-hlr_10.42.42.2(pid=20777): stderr: | [0;m[1;31m20221214005256978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005256978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005256978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005256978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005256978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005256978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005256990 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005256998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005256999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005256999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:52:59.859806 run osmo-msc_10.42.42.6(pid=20783): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20783)] 00:52:59.907182 run osmo-msc_10.42.42.6(pid=20783): stdout: | (launched: 2022-12-14_00:52:58.769248) 00:52:59.956754 run osmo-msc_10.42.42.6(pid=20783): stderr: | [0;m[38;5;43m20221214005259042 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005259042 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f106c026c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005259042 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005259042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005259042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005259043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005259044 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005259045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005259045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005259045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:53:00.006399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20776): Terminating (SIGTERM) 00:53:00.045914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20779): Terminating (SIGTERM) 00:53:00.086814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20782): Terminating (SIGTERM) 00:53:00.126759 --- ParallelTerminationStrategy: PID 20776 died... 00:53:00.146092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20776): Terminated: ok {rc=0} 00:53:00.189956 --- ParallelTerminationStrategy: PID 20779 died... 00:53:00.208597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20779): Terminated: ok {rc=0} 00:53:00.252729 --- ParallelTerminationStrategy: PID 20782 died... 00:53:00.271641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20782): Terminated: ok {rc=0} 00:53:00.355293 bus /sierra_3: Setting Powered False 00:53:01.468016 bus /sierra_3: Setting Powered False 00:53:02.587326 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 00:53:03.738080 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:53:03.750459 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:53:03.809809 tst mo_mt_call_osmux.py: using LAC 37409 00:53:03.940882 tst mo_mt_call_osmux.py: using RAC 179 00:53:04.070227 tst mo_mt_call_osmux.py: using CellId 37409 00:53:04.208346 tst mo_mt_call_osmux.py: using BVCI 37410 00:53:04.331919 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:53:04.343732 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:53:04.355178 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:53:04.366759 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:53:04.378528 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:53:04.390477 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:53:04.507921 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:53:04.629316 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:53:05.146191 run create_hlr_db(pid=20785): Launched 00:53:05.273758 bus /sierra_2: Setting Powered False 00:53:06.338479 run create_hlr_db(pid=20785): Terminated: ok {rc=0} 00:53:06.781168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20787): Launched 00:53:07.092055 run osmo-hlr_10.42.42.2(pid=20788): Launched 00:53:07.210060 run osmo-stp_10.42.42.5: Starting osmo-stp 00:53:07.743006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20790): Launched 00:53:08.054545 run osmo-stp_10.42.42.5(pid=20791): Launched 00:53:08.173133 run osmo-msc_10.42.42.6: Starting osmo-msc 00:53:08.731344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20793): Launched 00:53:09.045975 run osmo-msc_10.42.42.6(pid=20794): Launched 00:53:09.220569 run osmo-stp_10.42.42.5(pid=20791): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20791)] 00:53:09.351762 run osmo-stp_10.42.42.5(pid=20791): stdout: | (launched: 2022-12-14_00:53:07.996761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:09.482401 run osmo-stp_10.42.42.5(pid=20791): stderr: | [0;m[38;5;43m20221214005308165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005308166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005308166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005308166 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005308167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005308167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005308167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:09.611121 run osmo-stp_10.42.42.5(pid=20791): stdout: | (launched: 2022-12-14_00:53:07.996761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:09.734118 run osmo-stp_10.42.42.5(pid=20791): stderr: | [0;m[38;5;43m20221214005308165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005308166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005308166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005308166 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005308167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005308167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005308167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:09.881175 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20791): Process ended prematurely: osmo-stp_10.42.42.5(pid=20791) [trial-2397↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20791)] [trial-2397↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 00:53:09.890301 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:53:09.916473 run osmo-hlr_10.42.42.2(pid=20788): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20788)] 00:53:09.963709 run osmo-hlr_10.42.42.2(pid=20788): stdout: | (launched: 2022-12-14_00:53:07.034693) 00:53:10.012917 run osmo-hlr_10.42.42.2(pid=20788): stderr: | [0;m[1;31m20221214005307208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005307208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005307208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005307208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005307208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005307209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005307221 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005307229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005307229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005307229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:53:10.081390 run osmo-msc_10.42.42.6(pid=20794): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20794)] 00:53:10.128282 run osmo-msc_10.42.42.6(pid=20794): stdout: | (launched: 2022-12-14_00:53:08.985308) 00:53:10.176862 run osmo-msc_10.42.42.6(pid=20794): stderr: | [0;m[38;5;43m20221214005309257 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005309257 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f178d0aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005309257 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005309257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005309257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005309257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005309259 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005309259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005309260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005309260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:53:10.225791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20787): Terminating (SIGTERM) 00:53:10.265028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20790): Terminating (SIGTERM) 00:53:10.304036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20793): Terminating (SIGTERM) 00:53:10.343963 --- ParallelTerminationStrategy: PID 20787 died... 00:53:10.363217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20787): Terminated: ok {rc=0} 00:53:10.406858 --- ParallelTerminationStrategy: PID 20790 died... 00:53:10.425664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20790): Terminated: ok {rc=0} 00:53:10.469246 --- ParallelTerminationStrategy: PID 20793 died... 00:53:10.487626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20793): Terminated: ok {rc=0} 00:53:10.573620 bus /sierra_3: Setting Powered False 00:53:11.672152 bus /sierra_3: Setting Powered False 00:53:12.786604 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:53:14.019812 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:53:14.025467 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:53:14.045902 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 00:53:14.072493 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 00:53:14.125767 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:53:14.147116 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 00:53:14.174738 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 00:53:14.725791 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 00:53:14.781841 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:14.793225 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:53:14.853922 tst mo_mt_call.py: using LAC 37410 00:53:14.974588 tst mo_mt_call.py: using RAC 180 00:53:15.095734 tst mo_mt_call.py: using CellId 37410 00:53:15.214997 tst mo_mt_call.py: using BVCI 37411 00:53:15.328516 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:15.339699 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:15.350481 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:15.361312 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:15.371847 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:15.382559 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:53:15.504689 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:53:15.621061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:53:16.110286 run create_hlr_db(pid=20799): Launched 00:53:16.280202 bus /sierra_2: Setting Powered False 00:53:17.356123 run create_hlr_db(pid=20799): Terminated: ok {rc=0} 00:53:17.840152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20801): Launched 00:53:18.151381 run osmo-hlr_10.42.42.2(pid=20802): Launched 00:53:18.268505 run osmo-stp_10.42.42.5: Starting osmo-stp 00:53:18.798706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20804): Launched 00:53:19.111237 run osmo-stp_10.42.42.5(pid=20805): Launched 00:53:19.230528 run osmo-msc_10.42.42.6: Starting osmo-msc 00:53:19.788057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20807): Launched 00:53:20.100119 run osmo-msc_10.42.42.6(pid=20808): Launched 00:53:20.273756 run osmo-stp_10.42.42.5(pid=20805): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20805)] 00:53:20.403611 run osmo-stp_10.42.42.5(pid=20805): stdout: | (launched: 2022-12-14_00:53:19.053346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:20.533221 run osmo-stp_10.42.42.5(pid=20805): stderr: | [0;m[38;5;43m20221214005319224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005319224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005319224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005319225 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005319225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005319225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005319225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:20.661876 run osmo-stp_10.42.42.5(pid=20805): stdout: | (launched: 2022-12-14_00:53:19.053346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:20.784135 run osmo-stp_10.42.42.5(pid=20805): stderr: | [0;m[38;5;43m20221214005319224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005319224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005319224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005319225 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005319225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005319225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005319225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:20.931178 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20805): Process ended prematurely: osmo-stp_10.42.42.5(pid=20805) [trial-2397↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20805)] [trial-2397↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 00:53:20.940336 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:53:20.967160 run osmo-hlr_10.42.42.2(pid=20802): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20802)] 00:53:21.015464 run osmo-hlr_10.42.42.2(pid=20802): stdout: | (launched: 2022-12-14_00:53:18.094056) 00:53:21.065472 run osmo-hlr_10.42.42.2(pid=20802): stderr: | [0;m[1;31m20221214005318270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005318270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005318270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005318270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005318270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005318270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005318282 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005318290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005318290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005318290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:53:21.136018 run osmo-msc_10.42.42.6(pid=20808): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20808)] 00:53:21.184087 run osmo-msc_10.42.42.6(pid=20808): stdout: | (launched: 2022-12-14_00:53:20.042478) 00:53:21.233979 run osmo-msc_10.42.42.6(pid=20808): stderr: | [0;m[38;5;43m20221214005320314 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005320315 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2721564c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005320315 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005320315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005320315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005320315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005320317 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005320317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005320318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005320318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:53:21.284064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20801): Terminating (SIGTERM) 00:53:21.324388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20804): Terminating (SIGTERM) 00:53:21.364552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20807): Terminating (SIGTERM) 00:53:21.405148 --- ParallelTerminationStrategy: PID 20801 died... 00:53:21.424685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20801): Terminated: ok {rc=0} 00:53:21.469245 --- ParallelTerminationStrategy: PID 20804 died... 00:53:21.488422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20804): Terminated: ok {rc=0} 00:53:21.532835 --- ParallelTerminationStrategy: PID 20807 died... 00:53:21.552243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20807): Terminated: ok {rc=0} 00:53:21.639632 bus /sierra_3: Setting Powered False 00:53:22.739952 bus /sierra_3: Setting Powered False 00:53:23.854412 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 00:53:25.007048 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:25.019315 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:53:25.078674 tst mo_mt_call_osmux.py: using LAC 37411 00:53:25.208679 tst mo_mt_call_osmux.py: using RAC 181 00:53:25.330464 tst mo_mt_call_osmux.py: using CellId 37411 00:53:25.453045 tst mo_mt_call_osmux.py: using BVCI 37412 00:53:25.564713 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:25.575926 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:25.586822 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:25.597715 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:25.608733 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:53:25.619681 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:53:25.736299 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:53:25.857993 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:53:26.374685 run create_hlr_db(pid=20810): Launched 00:53:26.504700 bus /sierra_2: Setting Powered False 00:53:27.570000 run create_hlr_db(pid=20810): Terminated: ok {rc=0} 00:53:28.012826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20812): Launched 00:53:28.322797 run osmo-hlr_10.42.42.2(pid=20813): Launched 00:53:28.442237 run osmo-stp_10.42.42.5: Starting osmo-stp 00:53:28.974163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20815): Launched 00:53:29.286023 run osmo-stp_10.42.42.5(pid=20816): Launched 00:53:29.406117 run osmo-msc_10.42.42.6: Starting osmo-msc 00:53:29.967317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20818): Launched 00:53:30.279917 run osmo-msc_10.42.42.6(pid=20819): Launched 00:53:30.452691 run osmo-stp_10.42.42.5(pid=20816): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20816)] 00:53:30.582210 run osmo-stp_10.42.42.5(pid=20816): stdout: | (launched: 2022-12-14_00:53:29.227969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:30.712129 run osmo-stp_10.42.42.5(pid=20816): stderr: | [0;m[38;5;43m20221214005329399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005329399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005329399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005329400 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005329400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005329400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005329400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:30.847590 run osmo-stp_10.42.42.5(pid=20816): stdout: | (launched: 2022-12-14_00:53:29.227969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:30.990795 run osmo-stp_10.42.42.5(pid=20816): stderr: | [0;m[38;5;43m20221214005329399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005329399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005329399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005329400 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005329400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005329400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005329400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:31.142060 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20816): Process ended prematurely: osmo-stp_10.42.42.5(pid=20816) [trial-2397↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20816)] [trial-2397↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 00:53:31.152584 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:53:31.181030 run osmo-hlr_10.42.42.2(pid=20813): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20813)] 00:53:31.230931 run osmo-hlr_10.42.42.2(pid=20813): stdout: | (launched: 2022-12-14_00:53:28.265500) 00:53:31.281892 run osmo-hlr_10.42.42.2(pid=20813): stderr: | [0;m[1;31m20221214005328439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005328439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005328439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005328439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005328439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005328439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005328451 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005328461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005328461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005328461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:53:31.353236 run osmo-msc_10.42.42.6(pid=20819): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20819)] 00:53:31.402486 run osmo-msc_10.42.42.6(pid=20819): stdout: | (launched: 2022-12-14_00:53:30.222531) 00:53:31.453247 run osmo-msc_10.42.42.6(pid=20819): stderr: | [0;m[38;5;43m20221214005330494 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005330494 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f998c856c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005330494 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005330494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005330494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005330495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005330496 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005330497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005330497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005330497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:53:31.504194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20812): Terminating (SIGTERM) 00:53:31.545643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20815): Terminating (SIGTERM) 00:53:31.588081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20818): Terminating (SIGTERM) 00:53:31.629226 --- ParallelTerminationStrategy: PID 20812 died... 00:53:31.650282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20812): Terminated: ok {rc=0} 00:53:31.696595 --- ParallelTerminationStrategy: PID 20815 died... 00:53:31.716676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20815): Terminated: ok {rc=0} 00:53:31.762866 --- ParallelTerminationStrategy: PID 20818 died... 00:53:31.783026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20818): Terminated: ok {rc=0} 00:53:31.871202 bus /sierra_3: Setting Powered False 00:53:32.969313 bus /sierra_3: Setting Powered False 00:53:34.083523 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 emergency:oc2g --------------------------------------------------------------------- 00:53:35.320524 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:53:35.325285 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 00:53:35.346495 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 00:53:35.374511 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 00:53:35.463428 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 00:53:35.485592 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 00:53:35.513220 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 00:53:36.094166 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2397 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 00:53:36.100622 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:36.113183 tst emergency:oc2g: Using 1 x bts (candidates: 1) 00:53:36.148264 tst emergency_mo_mt_call.py: using LAC 37412 00:53:36.267744 tst emergency_mo_mt_call.py: using RAC 182 00:53:36.388130 tst emergency_mo_mt_call.py: using CellId 37412 00:53:36.508722 tst emergency_mo_mt_call.py: using BVCI 37413 00:53:36.628045 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:36.639153 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:36.650242 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:36.661133 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:36.672684 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:36.683889 tst emergency:oc2g: Using 1 x modem (candidates: 4) 00:53:36.799858 tst emergency:oc2g: Using 1 x modem (candidates: 4) 00:53:36.919711 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:53:37.427369 run create_hlr_db(pid=20825): Launched 00:53:37.551559 bus /sierra_2: Setting Powered False 00:53:38.615587 run create_hlr_db(pid=20825): Terminated: ok {rc=0} 00:53:39.071693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20827): Launched 00:53:39.401506 run osmo-hlr_10.42.42.2(pid=20828): Launched 00:53:39.529009 run osmo-stp_10.42.42.5: Starting osmo-stp 00:53:40.091527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20830): Launched 00:53:40.420866 run osmo-stp_10.42.42.5(pid=20831): Launched 00:53:40.556854 tst emergency_mo_mt_call.py: using MSISDN 8422 00:53:40.728346 run osmo-msc_10.42.42.6: Starting osmo-msc 00:53:41.315721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20833): Launched 00:53:41.642518 run osmo-msc_10.42.42.6(pid=20834): Launched 00:53:41.826485 run osmo-stp_10.42.42.5(pid=20831): ERR: Terminated: ERROR {rc=1} [trial-2397↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20831)] 00:53:41.963154 run osmo-stp_10.42.42.5(pid=20831): stdout: | (launched: 2022-12-14_00:53:40.360685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:42.101340 run osmo-stp_10.42.42.5(pid=20831): stderr: | [0;m[38;5;43m20221214005340552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005340552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005340552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005340553 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005340553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005340554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005340554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:42.238107 run osmo-stp_10.42.42.5(pid=20831): stdout: | (launched: 2022-12-14_00:53:40.360685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:42.368764 run osmo-stp_10.42.42.5(pid=20831): stderr: | [0;m[38;5;43m20221214005340552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005340552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005340552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005340553 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005340553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005340554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005340554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:42.524559 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=20831): Process ended prematurely: osmo-stp_10.42.42.5(pid=20831) [trial-2397↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20831)] [trial-2397↪emergency:oc2g↪emergency_mo_mt_call.py:19] 00:53:42.533923 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 00:53:42.561547 run osmo-hlr_10.42.42.2(pid=20828): ERR: Terminated: ERROR {rc=237} [trial-2397↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20828)] 00:53:42.612001 run osmo-hlr_10.42.42.2(pid=20828): stdout: | (launched: 2022-12-14_00:53:39.341220) 00:53:42.663787 run osmo-hlr_10.42.42.2(pid=20828): stderr: | [0;m[1;31m20221214005339538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005339538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005339538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005339538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005339538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005339538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005339550 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005339560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005339560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005339560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:53:42.736332 run osmo-msc_10.42.42.6(pid=20834): ERR: Terminated: ERROR {rc=2} [trial-2397↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20834)] 00:53:42.786203 run osmo-msc_10.42.42.6(pid=20834): stdout: | (launched: 2022-12-14_00:53:41.582268) 00:53:42.838132 run osmo-msc_10.42.42.6(pid=20834): stderr: | [0;m[38;5;43m20221214005341903 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005341903 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa0da4b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005341903 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005341903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005341904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005341904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005341906 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005341906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005341906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005341906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:53:42.890949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20827): Terminating (SIGTERM) 00:53:42.932422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20830): Terminating (SIGTERM) 00:53:42.974957 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20833): Terminating (SIGTERM) 00:53:43.017686 --- ParallelTerminationStrategy: PID 20827 died... 00:53:43.038223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20827): Terminated: ok {rc=0} 00:53:43.084809 --- ParallelTerminationStrategy: PID 20830 died... 00:53:43.105047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20830): Terminated: ok {rc=0} 00:53:43.151745 --- ParallelTerminationStrategy: PID 20833 died... 00:53:43.171755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20833): Terminated: ok {rc=0} 00:53:43.262101 bus /sierra_3: Setting Powered False 00:53:44.361203 bus /sierra_3: Setting Powered False 00:53:45.478421 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 00:53:46.568299 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:46.582509 tst emergency:oc2g: Using 1 x bts (candidates: 1) 00:53:46.623533 tst emergency_preemptive_call.py: using LAC 37413 00:53:46.775218 tst emergency_preemptive_call.py: using RAC 183 00:53:46.934471 tst emergency_preemptive_call.py: using CellId 37413 00:53:47.066890 tst emergency_preemptive_call.py: using BVCI 37414 00:53:47.210249 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:47.221629 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:47.232671 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:47.243866 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:47.255891 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 00:53:47.267089 tst emergency:oc2g: Using 1 x modem (candidates: 4) 00:53:47.383518 tst emergency:oc2g: Using 1 x modem (candidates: 4) 00:53:47.504836 tst emergency:oc2g: Using 1 x modem (candidates: 4) 00:53:47.622525 tst emergency:oc2g: Using 1 x modem (candidates: 4) 00:53:47.742791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:53:48.251402 run create_hlr_db(pid=20836): Launched 00:53:48.376788 bus /sierra_2: Setting Powered False 00:53:49.439639 run create_hlr_db(pid=20836): Terminated: ok {rc=0} 00:53:49.876802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20838): Launched 00:53:50.184122 run osmo-hlr_10.42.42.2(pid=20839): Launched 00:53:50.300747 run osmo-stp_10.42.42.5: Starting osmo-stp 00:53:50.828219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20841): Launched 00:53:51.134721 run osmo-stp_10.42.42.5(pid=20842): Launched 00:53:51.261455 tst emergency_preemptive_call.py: using MSISDN 8423 00:53:51.418360 run osmo-msc_10.42.42.6: Starting osmo-msc 00:53:51.963323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20844): Launched 00:53:52.267132 run osmo-msc_10.42.42.6(pid=20845): Launched 00:53:52.437932 run osmo-stp_10.42.42.5(pid=20842): ERR: Terminated: ERROR {rc=1} [trial-2397↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20842)] 00:53:52.564478 run osmo-stp_10.42.42.5(pid=20842): stdout: | (launched: 2022-12-14_00:53:51.078020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:52.691783 run osmo-stp_10.42.42.5(pid=20842): stderr: | [0;m[38;5;43m20221214005351250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005351250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005351250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005351250 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005351251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005351251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005351251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:52.817206 run osmo-stp_10.42.42.5(pid=20842): stdout: | (launched: 2022-12-14_00:53:51.078020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:53:52.937466 run osmo-stp_10.42.42.5(pid=20842): stderr: | [0;m[38;5;43m20221214005351250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005351250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005351250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005351250 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005351251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005351251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005351251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:53:53.081906 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=20842): Process ended prematurely: osmo-stp_10.42.42.5(pid=20842) [trial-2397↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20842)] [trial-2397↪emergency:oc2g↪emergency_preemptive_call.py:32] 00:53:53.090404 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 00:53:53.116827 run osmo-hlr_10.42.42.2(pid=20839): ERR: Terminated: ERROR {rc=237} [trial-2397↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20839)] 00:53:53.164876 run osmo-hlr_10.42.42.2(pid=20839): stdout: | (launched: 2022-12-14_00:53:50.127089) 00:53:53.213978 run osmo-hlr_10.42.42.2(pid=20839): stderr: | [0;m[1;31m20221214005350302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005350302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005350302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005350302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005350302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005350302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005350314 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005350322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005350322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005350322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:53:53.282630 run osmo-msc_10.42.42.6(pid=20845): ERR: Terminated: ERROR {rc=2} [trial-2397↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20845)] 00:53:53.330173 run osmo-msc_10.42.42.6(pid=20845): stdout: | (launched: 2022-12-14_00:53:52.210125) 00:53:53.379250 run osmo-msc_10.42.42.6(pid=20845): stderr: | [0;m[38;5;43m20221214005352480 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005352480 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd416df5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005352480 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005352481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005352481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005352481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005352483 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005352483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005352483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005352483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:53:53.428666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20838): Terminating (SIGTERM) 00:53:53.468305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20841): Terminating (SIGTERM) 00:53:53.507927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20844): Terminating (SIGTERM) 00:53:53.547852 --- ParallelTerminationStrategy: PID 20838 died... 00:53:53.567301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20838): Terminated: ok {rc=0} 00:53:53.611261 --- ParallelTerminationStrategy: PID 20841 died... 00:53:53.630120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20841): Terminated: ok {rc=0} 00:53:53.673844 --- ParallelTerminationStrategy: PID 20844 died... 00:53:53.692915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20844): Terminated: ok {rc=0} 00:53:53.779820 bus /sierra_9: Setting Powered False 00:53:54.880462 bus /sierra_9: Setting Powered False 00:53:55.992889 bus /sierra_8: Setting Powered False 00:53:57.090329 bus /sierra_8: Setting Powered False 00:53:58.203899 bus /sierra_3: Setting Powered False 00:53:59.302915 bus /sierra_3: Setting Powered False 00:54:00.416261 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:oc2g --------------------------------------------------------------------- 00:54:01.711973 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:54:01.717519 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 00:54:01.746847 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 00:54:01.797664 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 00:54:01.895009 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 00:54:01.926846 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 00:54:01.996516 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 00:54:02.609253 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 00:54:02.680186 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:02.695600 tst gprs:oc2g: Using 1 x bts (candidates: 1) 00:54:02.739113 tst cs_paging_gprs_active.py: using LAC 37414 00:54:02.890096 tst cs_paging_gprs_active.py: using RAC 184 00:54:03.053774 tst cs_paging_gprs_active.py: using CellId 37414 00:54:03.206958 tst cs_paging_gprs_active.py: using BVCI 37415 00:54:03.350205 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:03.365771 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:03.380607 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:03.396758 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:03.412612 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:03.429732 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:03.443578 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:03.461137 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:03.474413 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:03.623722 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:03.765450 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:54:04.045017 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:04.419850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21119): Launched 00:54:04.732522 run iperf3-srv_10.42.42.10(pid=21120): Launched 00:54:04.861197 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:54:05.093094 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:05.441485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21121): Launched 00:54:05.750958 run iperf3-srv_10.42.42.10(pid=21122): Launched 00:54:05.893030 tst cs_paging_gprs_active.py:38: start network... 00:54:06.124607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:54:06.652666 run create_hlr_db(pid=21124): Launched 00:54:06.806437 bus /sierra_2: Setting Powered False 00:54:07.869442 run create_hlr_db(pid=21124): Terminated: ok {rc=0} 00:54:08.309715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21127): Launched 00:54:08.638741 run osmo-hlr_10.42.42.2(pid=21128): Launched 00:54:08.880601 run osmo-stp_10.42.42.5: Starting osmo-stp 00:54:09.592118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21130): Launched 00:54:09.924711 run osmo-stp_10.42.42.5(pid=21131): Launched 00:54:10.173148 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:54:10.856173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21133): Launched 00:54:10.990448 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:54:11.260460 run patchelf(pid=21134): Launched 00:54:11.452299 run osmo-stp_10.42.42.5(pid=21131): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21131)] 00:54:11.589478 run osmo-stp_10.42.42.5(pid=21131): stdout: | (launched: 2022-12-14_00:54:09.866015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:11.727471 run osmo-stp_10.42.42.5(pid=21131): stderr: | [0;m[38;5;43m20221214005410187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005410188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005410188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005410188 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005410189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005410189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005410189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:11.866906 run osmo-stp_10.42.42.5(pid=21131): stdout: | (launched: 2022-12-14_00:54:09.866015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:11.998768 run osmo-stp_10.42.42.5(pid=21131): stderr: | [0;m[38;5;43m20221214005410187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005410188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005410188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005410188 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005410189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005410189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005410189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:12.154698 run patchelf(pid=21134): Terminating (SIGINT) 00:54:12.335349 run patchelf(pid=21134): Terminated: ok {rc=0} 00:54:12.465466 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21131): Process ended prematurely: osmo-stp_10.42.42.5(pid=21131) [trial-2397↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21131)] [trial-2397↪gprs:oc2g↪cs_paging_gprs_active.py:38] 00:54:12.475967 tst cs_paging_gprs_active.py:38: Test FAILED (9.9 sec) 00:54:12.505645 run osmo-hlr_10.42.42.2(pid=21128): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21128)] 00:54:12.556198 run osmo-hlr_10.42.42.2(pid=21128): stdout: | (launched: 2022-12-14_00:54:08.580290) 00:54:12.608719 run osmo-hlr_10.42.42.2(pid=21128): stderr: | [0;m[1;31m20221214005408910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005408910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005408910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005408910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005408910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005408910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005408933 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005408947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005408947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005408947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:54:12.661149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21119): Terminating (SIGTERM) 00:54:12.705935 run iperf3-srv_10.42.42.10(pid=21120): Terminating (SIGTERM) 00:54:12.750984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21121): Terminating (SIGTERM) 00:54:12.793721 run iperf3-srv_10.42.42.10(pid=21122): Terminating (SIGTERM) 00:54:12.838534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21127): Terminating (SIGTERM) 00:54:12.882527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21130): Terminating (SIGTERM) 00:54:12.926423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21133): Terminating (SIGTERM) 00:54:12.970705 --- ParallelTerminationStrategy: PID 21119 died... 00:54:12.990981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21119): Terminated: ok {rc=0} 00:54:13.038355 --- ParallelTerminationStrategy: PID 21120 died... 00:54:13.058459 run iperf3-srv_10.42.42.10(pid=21120): Terminated {rc=256} 00:54:13.105253 --- ParallelTerminationStrategy: PID 21121 died... 00:54:13.125915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21121): Terminated: ok {rc=0} 00:54:13.172311 --- ParallelTerminationStrategy: PID 21122 died... 00:54:13.192377 run iperf3-srv_10.42.42.10(pid=21122): Terminated {rc=256} 00:54:13.237818 --- ParallelTerminationStrategy: PID 21127 died... 00:54:13.257452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21127): Terminated: ok {rc=0} 00:54:13.303960 --- ParallelTerminationStrategy: PID 21130 died... 00:54:13.323706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21130): Terminated: ok {rc=0} 00:54:13.369571 --- ParallelTerminationStrategy: PID 21133 died... 00:54:13.389215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21133): Terminated: ok {rc=0} 00:54:13.476429 bus /gobi_0: Setting Powered False 00:54:14.577183 bus /gobi_0: Setting Powered False 00:54:15.695428 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:oc2g iperf3.py ---------------------------------------------- 00:54:16.892526 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:16.914335 tst gprs:oc2g: Using 1 x bts (candidates: 1) 00:54:16.977798 tst iperf3.py: using LAC 37415 00:54:17.158794 tst iperf3.py: using RAC 185 00:54:17.310465 tst iperf3.py: using CellId 37415 00:54:17.478463 tst iperf3.py: using BVCI 37416 00:54:17.664319 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:17.676616 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:17.689200 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:17.701481 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:17.719867 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:17.737049 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:17.752032 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:17.765848 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:17.778170 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:17.910563 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:54:18.140038 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:18.463424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21135): Launched 00:54:18.764028 run iperf3-srv_10.42.42.10(pid=21136): Launched 00:54:18.903398 tst iperf3.py:8: start network... 00:54:19.122671 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:54:19.624771 run create_hlr_db(pid=21137): Launched 00:54:19.791235 bus /gobi_6: Setting Powered False 00:54:20.855470 run create_hlr_db(pid=21137): Terminated: ok {rc=0} 00:54:21.305383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21139): Launched 00:54:21.641148 run osmo-hlr_10.42.42.2(pid=21140): Launched 00:54:21.890758 run osmo-stp_10.42.42.5: Starting osmo-stp 00:54:22.542107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21142): Launched 00:54:22.880570 run osmo-stp_10.42.42.5(pid=21143): Launched 00:54:23.137464 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:54:23.832118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21145): Launched 00:54:23.969909 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:54:24.244186 run patchelf(pid=21146): Launched 00:54:24.438677 run osmo-stp_10.42.42.5(pid=21143): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21143)] 00:54:24.584807 run osmo-stp_10.42.42.5(pid=21143): stdout: | (launched: 2022-12-14_00:54:22.820250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:24.730149 run osmo-stp_10.42.42.5(pid=21143): stderr: | [0;m[38;5;43m20221214005423153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005423153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005423154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005423154 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005423155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005423155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005423155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:24.873995 run osmo-stp_10.42.42.5(pid=21143): stdout: | (launched: 2022-12-14_00:54:22.820250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:25.010317 run osmo-stp_10.42.42.5(pid=21143): stderr: | [0;m[38;5;43m20221214005423153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005423153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005423154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005423154 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005423155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005423155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005423155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:25.171882 run patchelf(pid=21146): Terminating (SIGINT) 00:54:25.358332 run patchelf(pid=21146): Terminated: ok {rc=0} 00:54:25.493190 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21143): Process ended prematurely: osmo-stp_10.42.42.5(pid=21143) [trial-2397↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21143)] [trial-2397↪gprs:oc2g↪iperf3.py:8] 00:54:25.503867 tst iperf3.py:8: Test FAILED (8.7 sec) 00:54:25.533085 run osmo-hlr_10.42.42.2(pid=21140): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21140)] 00:54:25.584410 run osmo-hlr_10.42.42.2(pid=21140): stdout: | (launched: 2022-12-14_00:54:21.581885) 00:54:25.637344 run osmo-hlr_10.42.42.2(pid=21140): stderr: | [0;m[1;31m20221214005421921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005421921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005421921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005421921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005421921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005421921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005421939 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005421952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005421952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005421952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:54:25.690610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21135): Terminating (SIGTERM) 00:54:25.732862 run iperf3-srv_10.42.42.10(pid=21136): Terminating (SIGTERM) 00:54:25.775752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21139): Terminating (SIGTERM) 00:54:25.818453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21142): Terminating (SIGTERM) 00:54:25.861304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21145): Terminating (SIGTERM) 00:54:25.904282 --- ParallelTerminationStrategy: PID 21135 died... 00:54:25.924706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21135): Terminated: ok {rc=0} 00:54:25.971997 --- ParallelTerminationStrategy: PID 21136 died... 00:54:25.992105 run iperf3-srv_10.42.42.10(pid=21136): Terminated {rc=256} 00:54:26.038773 --- ParallelTerminationStrategy: PID 21139 died... 00:54:26.058861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21139): Terminated: ok {rc=0} 00:54:26.105681 --- ParallelTerminationStrategy: PID 21142 died... 00:54:26.125955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21142): Terminated: ok {rc=0} 00:54:26.172649 --- ParallelTerminationStrategy: PID 21145 died... 00:54:26.192889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21145): Terminated: ok {rc=0} 00:54:26.280942 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:oc2g iperf3m4.py ---------------------------------------------- 00:54:27.431984 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:27.444022 tst gprs:oc2g: Using 1 x bts (candidates: 1) 00:54:27.481537 tst iperf3m4.py: using LAC 37416 00:54:27.612916 tst iperf3m4.py: using RAC 186 00:54:27.742636 tst iperf3m4.py: using CellId 37416 00:54:27.873773 tst iperf3m4.py: using BVCI 37417 00:54:27.996547 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:28.007758 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:28.018916 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:28.029918 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:28.041007 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:28.052085 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:28.063422 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:28.074657 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:28.085972 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:28.204425 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:28.325545 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:28.440562 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:28.560637 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:54:28.785977 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:29.123089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21148): Launched 00:54:29.415209 run iperf3-srv_10.42.42.10(pid=21149): Launched 00:54:29.541921 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:54:29.766734 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:30.102492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21150): Launched 00:54:30.395999 run iperf3-srv_10.42.42.10(pid=21151): Launched 00:54:30.522859 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:54:30.747203 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:31.098883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21152): Launched 00:54:31.471608 run iperf3-srv_10.42.42.10(pid=21153): Launched 00:54:31.612703 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:54:31.842061 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:54:32.183512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21154): Launched 00:54:32.488491 run iperf3-srv_10.42.42.10(pid=21155): Launched 00:54:32.615352 tst iperf3m4.py:8: start network... 00:54:32.839324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:54:33.355327 run create_hlr_db(pid=21156): Launched 00:54:33.483472 bus /gobi_6: Setting Powered False 00:54:34.545142 run create_hlr_db(pid=21156): Terminated: ok {rc=0} 00:54:35.008265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21158): Launched 00:54:35.345797 run osmo-hlr_10.42.42.2(pid=21160): Launched 00:54:35.474660 run osmo-stp_10.42.42.5: Starting osmo-stp 00:54:36.047680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21162): Launched 00:54:36.383580 run osmo-stp_10.42.42.5(pid=21163): Launched 00:54:36.512516 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:54:37.087981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21165): Launched 00:54:37.216390 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:54:37.499305 run patchelf(pid=21166): Launched 00:54:37.686271 run osmo-stp_10.42.42.5(pid=21163): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21163)] 00:54:37.827255 run osmo-stp_10.42.42.5(pid=21163): stdout: | (launched: 2022-12-14_00:54:36.321510) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:37.969964 run osmo-stp_10.42.42.5(pid=21163): stderr: | [0;m[38;5;43m20221214005436514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005436514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005436514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005436515 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005436515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005436515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005436515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:38.112937 run osmo-stp_10.42.42.5(pid=21163): stdout: | (launched: 2022-12-14_00:54:36.321510) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:38.249200 run osmo-stp_10.42.42.5(pid=21163): stderr: | [0;m[38;5;43m20221214005436514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005436514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005436514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005436515 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005436515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005436515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005436515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:38.411105 run patchelf(pid=21166): Terminating (SIGINT) 00:54:38.597235 run patchelf(pid=21166): Terminated: ok {rc=0} 00:54:38.731952 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21163): Process ended prematurely: osmo-stp_10.42.42.5(pid=21163) [trial-2397↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21163)] [trial-2397↪gprs:oc2g↪iperf3m4.py:8] 00:54:38.742422 tst iperf3m4.py:8: Test FAILED (11.4 sec) 00:54:38.771521 run osmo-hlr_10.42.42.2(pid=21160): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21160)] 00:54:38.822640 run osmo-hlr_10.42.42.2(pid=21160): stdout: | (launched: 2022-12-14_00:54:35.283324) 00:54:38.875323 run osmo-hlr_10.42.42.2(pid=21160): stderr: | [0;m[1;31m20221214005435484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005435484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005435484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005435484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005435484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005435484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005435496 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005435504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005435505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005435505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:54:38.928379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21148): Terminating (SIGTERM) 00:54:38.970678 run iperf3-srv_10.42.42.10(pid=21149): Terminating (SIGTERM) 00:54:39.013477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21150): Terminating (SIGTERM) 00:54:39.055972 run iperf3-srv_10.42.42.10(pid=21151): Terminating (SIGTERM) 00:54:39.098362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21152): Terminating (SIGTERM) 00:54:39.141225 run iperf3-srv_10.42.42.10(pid=21153): Terminating (SIGTERM) 00:54:39.183491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21154): Terminating (SIGTERM) 00:54:39.226342 run iperf3-srv_10.42.42.10(pid=21155): Terminating (SIGTERM) 00:54:39.268395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21158): Terminating (SIGTERM) 00:54:39.311097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21162): Terminating (SIGTERM) 00:54:39.353858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21165): Terminating (SIGTERM) 00:54:39.396479 --- ParallelTerminationStrategy: PID 21148 died... 00:54:39.417148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21148): Terminated: ok {rc=0} 00:54:39.464214 --- ParallelTerminationStrategy: PID 21149 died... 00:54:39.484241 run iperf3-srv_10.42.42.10(pid=21149): Terminated {rc=256} 00:54:39.530955 --- ParallelTerminationStrategy: PID 21150 died... 00:54:39.551110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21150): Terminated: ok {rc=0} 00:54:39.597799 --- ParallelTerminationStrategy: PID 21151 died... 00:54:39.617950 run iperf3-srv_10.42.42.10(pid=21151): Terminated {rc=256} 00:54:39.664400 --- ParallelTerminationStrategy: PID 21152 died... 00:54:39.684549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21152): Terminated: ok {rc=0} 00:54:39.731677 --- ParallelTerminationStrategy: PID 21153 died... 00:54:39.751868 run iperf3-srv_10.42.42.10(pid=21153): Terminated {rc=256} 00:54:39.799150 --- ParallelTerminationStrategy: PID 21154 died... 00:54:39.819288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21154): Terminated: ok {rc=0} 00:54:39.866142 --- ParallelTerminationStrategy: PID 21155 died... 00:54:39.886376 run iperf3-srv_10.42.42.10(pid=21155): Terminated {rc=256} 00:54:39.933221 --- ParallelTerminationStrategy: PID 21158 died... 00:54:39.953432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21158): Terminated: ok {rc=0} 00:54:40.000230 --- ParallelTerminationStrategy: PID 21162 died... 00:54:40.020384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21162): Terminated: ok {rc=0} 00:54:40.067204 --- ParallelTerminationStrategy: PID 21165 died... 00:54:40.087406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21165): Terminated: ok {rc=0} 00:54:40.177522 bus /gobi_4: Setting Powered False 00:54:41.274721 bus /gobi_4: Setting Powered False 00:54:42.392058 bus /gobi_1: Setting Powered False 00:54:43.491946 bus /gobi_1: Setting Powered False 00:54:44.608655 bus /gobi_0: Setting Powered False 00:54:45.707646 bus /gobi_0: Setting Powered False 00:54:46.826561 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:oc2g ping.py ---------------------------------------------- 00:54:47.937657 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:47.948895 tst gprs:oc2g: Using 1 x bts (candidates: 1) 00:54:47.984581 tst ping.py: using LAC 37417 00:54:48.112830 tst ping.py: using RAC 187 00:54:48.238826 tst ping.py: using CellId 37417 00:54:48.365582 tst ping.py: using BVCI 37418 00:54:48.486718 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:48.498021 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:48.509116 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:48.520006 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:48.531167 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:48.542366 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:48.553697 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:48.565149 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:48.688071 tst ping.py:19: start network... 00:54:48.909345 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:54:49.415544 run create_hlr_db(pid=21167): Launched 00:54:49.539868 bus /gobi_6: Setting Powered False 00:54:50.603542 run create_hlr_db(pid=21167): Terminated: ok {rc=0} 00:54:51.041379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21169): Launched 00:54:51.348525 run osmo-hlr_10.42.42.2(pid=21170): Launched 00:54:51.465143 run osmo-stp_10.42.42.5: Starting osmo-stp 00:54:51.990527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21172): Launched 00:54:52.297716 run osmo-stp_10.42.42.5(pid=21173): Launched 00:54:52.416444 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:54:52.941370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21175): Launched 00:54:53.057417 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:54:53.313959 run patchelf(pid=21176): Launched 00:54:53.485227 run osmo-stp_10.42.42.5(pid=21173): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21173)] 00:54:53.612919 run osmo-stp_10.42.42.5(pid=21173): stdout: | (launched: 2022-12-14_00:54:52.240597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:53.743179 run osmo-stp_10.42.42.5(pid=21173): stderr: | [0;m[38;5;43m20221214005452412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005452412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005452412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005452413 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005452413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005452413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005452413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:53.873973 run osmo-stp_10.42.42.5(pid=21173): stdout: | (launched: 2022-12-14_00:54:52.240597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:54:53.997829 run osmo-stp_10.42.42.5(pid=21173): stderr: | [0;m[38;5;43m20221214005452412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005452412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005452412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005452413 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005452413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005452413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005452413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:54:54.144477 run patchelf(pid=21176): Terminating (SIGINT) 00:54:54.314148 run patchelf(pid=21176): Terminated: ok {rc=0} 00:54:54.436509 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21173): Process ended prematurely: osmo-stp_10.42.42.5(pid=21173) [trial-2397↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21173)] [trial-2397↪gprs:oc2g↪ping.py:22] 00:54:54.445513 tst ping.py:22: Test FAILED (6.5 sec) 00:54:54.472791 run osmo-hlr_10.42.42.2(pid=21170): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21170)] 00:54:54.520751 run osmo-hlr_10.42.42.2(pid=21170): stdout: | (launched: 2022-12-14_00:54:51.291250) 00:54:54.570739 run osmo-hlr_10.42.42.2(pid=21170): stderr: | [0;m[1;31m20221214005451467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005451467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005451467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005451467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005451467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005451467 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005451480 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005451490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005451490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005451490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:54:54.620904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21169): Terminating (SIGTERM) 00:54:54.661189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21172): Terminating (SIGTERM) 00:54:54.701436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21175): Terminating (SIGTERM) 00:54:54.741778 --- ParallelTerminationStrategy: PID 21169 died... 00:54:54.761283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21169): Terminated: ok {rc=0} 00:54:54.805782 --- ParallelTerminationStrategy: PID 21172 died... 00:54:54.824667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21172): Terminated: ok {rc=0} 00:54:54.869671 --- ParallelTerminationStrategy: PID 21175 died... 00:54:54.888480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21175): Terminated: ok {rc=0} 00:54:54.975983 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 00:54:56.066766 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:56.078606 tst gprs:oc2g: Using 1 x bts (candidates: 1) 00:54:56.115457 tst ping_idle_ping.py: using LAC 37418 00:54:56.237003 tst ping_idle_ping.py: using RAC 188 00:54:56.361672 tst ping_idle_ping.py: using CellId 37418 00:54:56.481190 tst ping_idle_ping.py: using BVCI 37419 00:54:56.592636 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:56.603239 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:56.613785 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:56.624129 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:56.634463 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:56.645001 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:56.655998 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 00:54:56.666800 tst gprs:oc2g: Using 1 x modem (candidates: 4) 00:54:56.787263 tst ping_idle_ping.py:24: start network... 00:54:57.009147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:54:57.520889 run create_hlr_db(pid=21177): Launched 00:54:57.648635 bus /gobi_6: Setting Powered False 00:54:58.713319 run create_hlr_db(pid=21177): Terminated: ok {rc=0} 00:54:59.170672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21179): Launched 00:54:59.502313 run osmo-hlr_10.42.42.2(pid=21180): Launched 00:54:59.629790 run osmo-stp_10.42.42.5: Starting osmo-stp 00:55:00.195444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21182): Launched 00:55:00.510626 run osmo-stp_10.42.42.5(pid=21183): Launched 00:55:00.629333 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:55:01.211941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21185): Launched 00:55:01.352669 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:55:01.637356 run patchelf(pid=21186): Launched 00:55:01.854249 run osmo-stp_10.42.42.5(pid=21183): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21183)] 00:55:02.001606 run osmo-stp_10.42.42.5(pid=21183): stdout: | (launched: 2022-12-14_00:55:00.453695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:02.147471 run osmo-stp_10.42.42.5(pid=21183): stderr: | [0;m[38;5;43m20221214005500625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005500625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005500625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005500626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005500626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005500626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005500626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:02.292407 run osmo-stp_10.42.42.5(pid=21183): stdout: | (launched: 2022-12-14_00:55:00.453695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:02.427990 run osmo-stp_10.42.42.5(pid=21183): stderr: | [0;m[38;5;43m20221214005500625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005500625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005500625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005500626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005500626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005500626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005500626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:02.587709 run patchelf(pid=21186): Terminating (SIGINT) 00:55:02.771531 run patchelf(pid=21186): Terminated: ok {rc=0} 00:55:02.904099 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21183): Process ended prematurely: osmo-stp_10.42.42.5(pid=21183) [trial-2397↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21183)] [trial-2397↪gprs:oc2g↪ping_idle_ping.py:27] 00:55:02.914244 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 00:55:02.943254 run osmo-hlr_10.42.42.2(pid=21180): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21180)] 00:55:02.995362 run osmo-hlr_10.42.42.2(pid=21180): stdout: | (launched: 2022-12-14_00:54:59.441513) 00:55:03.048144 run osmo-hlr_10.42.42.2(pid=21180): stderr: | [0;m[1;31m20221214005459640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005459640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005459640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005459640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005459640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005459640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005459652 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005459660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005459660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005459660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:55:03.101861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21179): Terminating (SIGTERM) 00:55:03.144122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21182): Terminating (SIGTERM) 00:55:03.187172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21185): Terminating (SIGTERM) 00:55:03.230340 --- ParallelTerminationStrategy: PID 21179 died... 00:55:03.251215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21179): Terminated: ok {rc=0} 00:55:03.298319 --- ParallelTerminationStrategy: PID 21182 died... 00:55:03.318683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21182): Terminated: ok {rc=0} 00:55:03.366100 --- ParallelTerminationStrategy: PID 21185 died... 00:55:03.386478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21185): Terminated: ok {rc=0} 00:55:03.475792 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 00:55:04.768517 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:55:04.774503 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 00:55:04.795666 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 00:55:04.836565 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 00:55:04.926204 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 00:55:04.947286 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 00:55:04.986909 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 00:55:05.580101 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 00:55:05.633490 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:05.644813 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:55:05.681929 tst cs_paging_gprs_active.py: using LAC 37419 00:55:05.811374 tst cs_paging_gprs_active.py: using RAC 189 00:55:05.945798 tst cs_paging_gprs_active.py: using CellId 37419 00:55:06.076581 tst cs_paging_gprs_active.py: using BVCI 37420 00:55:06.196567 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:06.207820 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:06.218835 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:06.229818 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:06.240995 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:06.251813 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:06.263059 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:06.274385 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:06.286560 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:06.403267 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:06.522351 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:55:06.744199 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:07.073379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21193): Launched 00:55:07.362065 run iperf3-srv_10.42.42.10(pid=21194): Launched 00:55:07.485312 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:55:07.706211 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:08.034743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21195): Launched 00:55:08.322220 run iperf3-srv_10.42.42.10(pid=21196): Launched 00:55:08.447057 tst cs_paging_gprs_active.py:38: start network... 00:55:08.667401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:55:09.175230 run create_hlr_db(pid=21197): Launched 00:55:09.302124 bus /gobi_6: Setting Powered False 00:55:10.366703 run create_hlr_db(pid=21197): Terminated: ok {rc=0} 00:55:10.803701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21199): Launched 00:55:11.133990 run osmo-hlr_10.42.42.2(pid=21200): Launched 00:55:11.262315 run osmo-stp_10.42.42.5: Starting osmo-stp 00:55:11.826296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21202): Launched 00:55:12.154114 run osmo-stp_10.42.42.5(pid=21203): Launched 00:55:12.281125 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:55:12.845692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21205): Launched 00:55:12.973507 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:55:13.251730 run patchelf(pid=21206): Launched 00:55:13.436231 run osmo-stp_10.42.42.5(pid=21203): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21203)] 00:55:13.575082 run osmo-stp_10.42.42.5(pid=21203): stdout: | (launched: 2022-12-14_00:55:12.093859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:13.715584 run osmo-stp_10.42.42.5(pid=21203): stderr: | [0;m[38;5;43m20221214005512287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005512287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005512287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005512287 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005512288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005512288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005512288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:13.856148 run osmo-stp_10.42.42.5(pid=21203): stdout: | (launched: 2022-12-14_00:55:12.093859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:13.990373 run osmo-stp_10.42.42.5(pid=21203): stderr: | [0;m[38;5;43m20221214005512287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005512287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005512287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005512287 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005512288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005512288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005512288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:14.149570 run patchelf(pid=21206): Terminating (SIGINT) 00:55:14.333570 run patchelf(pid=21206): Terminated: ok {rc=0} 00:55:14.465913 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21203): Process ended prematurely: osmo-stp_10.42.42.5(pid=21203) [trial-2397↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21203)] [trial-2397↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 00:55:14.476128 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 00:55:14.504670 run osmo-hlr_10.42.42.2(pid=21200): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21200)] 00:55:14.555485 run osmo-hlr_10.42.42.2(pid=21200): stdout: | (launched: 2022-12-14_00:55:11.073683) 00:55:14.607874 run osmo-hlr_10.42.42.2(pid=21200): stderr: | [0;m[1;31m20221214005511270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005511270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005511270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005511270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005511270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005511270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005511283 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005511291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005511291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005511291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:55:14.660591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21193): Terminating (SIGTERM) 00:55:14.702725 run iperf3-srv_10.42.42.10(pid=21194): Terminating (SIGTERM) 00:55:14.745044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21195): Terminating (SIGTERM) 00:55:14.787902 run iperf3-srv_10.42.42.10(pid=21196): Terminating (SIGTERM) 00:55:14.830391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21199): Terminating (SIGTERM) 00:55:14.873070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21202): Terminating (SIGTERM) 00:55:14.915368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21205): Terminating (SIGTERM) 00:55:14.957869 --- ParallelTerminationStrategy: PID 21193 died... 00:55:14.978279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21193): Terminated: ok {rc=0} 00:55:15.025250 --- ParallelTerminationStrategy: PID 21194 died... 00:55:15.045565 run iperf3-srv_10.42.42.10(pid=21194): Terminated {rc=256} 00:55:15.091958 --- ParallelTerminationStrategy: PID 21195 died... 00:55:15.111832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21195): Terminated: ok {rc=0} 00:55:15.157973 --- ParallelTerminationStrategy: PID 21196 died... 00:55:15.177858 run iperf3-srv_10.42.42.10(pid=21196): Terminated {rc=256} 00:55:15.224220 --- ParallelTerminationStrategy: PID 21199 died... 00:55:15.244191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21199): Terminated: ok {rc=0} 00:55:15.290326 --- ParallelTerminationStrategy: PID 21202 died... 00:55:15.310204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21202): Terminated: ok {rc=0} 00:55:15.356694 --- ParallelTerminationStrategy: PID 21205 died... 00:55:15.376706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21205): Terminated: ok {rc=0} 00:55:15.466221 bus /gobi_0: Setting Powered False 00:55:16.564656 bus /gobi_0: Setting Powered False 00:55:17.679556 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 00:55:18.829961 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:18.842029 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:55:18.880592 tst iperf3.py: using LAC 37420 00:55:19.010262 tst iperf3.py: using RAC 190 00:55:19.140502 tst iperf3.py: using CellId 37420 00:55:19.264587 tst iperf3.py: using BVCI 37421 00:55:19.375550 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:19.386587 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:19.397537 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:19.408224 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:19.419383 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:19.430621 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:19.441951 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:19.453167 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:19.464511 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:19.586611 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:55:19.791221 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:20.099277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21207): Launched 00:55:20.369040 run iperf3-srv_10.42.42.10(pid=21208): Launched 00:55:20.483285 tst iperf3.py:8: start network... 00:55:20.686951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:55:21.159308 run create_hlr_db(pid=21209): Launched 00:55:21.284074 bus /gobi_6: Setting Powered False 00:55:22.344027 run create_hlr_db(pid=21209): Terminated: ok {rc=0} 00:55:22.788681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21211): Launched 00:55:23.100225 run osmo-hlr_10.42.42.2(pid=21212): Launched 00:55:23.216706 run osmo-stp_10.42.42.5: Starting osmo-stp 00:55:23.740687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21214): Launched 00:55:24.046560 run osmo-stp_10.42.42.5(pid=21215): Launched 00:55:24.162057 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:55:24.685499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21217): Launched 00:55:24.803834 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:55:25.062622 run patchelf(pid=21218): Launched 00:55:25.232282 run osmo-stp_10.42.42.5(pid=21215): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21215)] 00:55:25.361196 run osmo-stp_10.42.42.5(pid=21215): stdout: | (launched: 2022-12-14_00:55:23.989867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:25.492740 run osmo-stp_10.42.42.5(pid=21215): stderr: | [0;m[38;5;43m20221214005524161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005524161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005524162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005524162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005524163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005524163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005524163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:25.623523 run osmo-stp_10.42.42.5(pid=21215): stdout: | (launched: 2022-12-14_00:55:23.989867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:25.747610 run osmo-stp_10.42.42.5(pid=21215): stderr: | [0;m[38;5;43m20221214005524161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005524161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005524162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005524162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005524163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005524163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005524163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:25.894629 run patchelf(pid=21218): Terminating (SIGINT) 00:55:26.064346 run patchelf(pid=21218): Terminated: ok {rc=0} 00:55:26.187551 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21215): Process ended prematurely: osmo-stp_10.42.42.5(pid=21215) [trial-2397↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21215)] [trial-2397↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 00:55:26.197248 tst iperf3.py:8: Test FAILED (7.4 sec) 00:55:26.224028 run osmo-hlr_10.42.42.2(pid=21212): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21212)] 00:55:26.271176 run osmo-hlr_10.42.42.2(pid=21212): stdout: | (launched: 2022-12-14_00:55:23.043624) 00:55:26.319910 run osmo-hlr_10.42.42.2(pid=21212): stderr: | [0;m[1;31m20221214005523220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005523220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005523220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005523220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005523220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005523220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005523232 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005523242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005523242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005523242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:55:26.369209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21207): Terminating (SIGTERM) 00:55:26.408573 run iperf3-srv_10.42.42.10(pid=21208): Terminating (SIGTERM) 00:55:26.447841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21211): Terminating (SIGTERM) 00:55:26.487129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21214): Terminating (SIGTERM) 00:55:26.526574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21217): Terminating (SIGTERM) 00:55:26.566340 --- ParallelTerminationStrategy: PID 21207 died... 00:55:26.585419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21207): Terminated: ok {rc=0} 00:55:26.629413 --- ParallelTerminationStrategy: PID 21208 died... 00:55:26.647821 run iperf3-srv_10.42.42.10(pid=21208): Terminated {rc=256} 00:55:26.691612 --- ParallelTerminationStrategy: PID 21211 died... 00:55:26.710295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21211): Terminated: ok {rc=0} 00:55:26.753906 --- ParallelTerminationStrategy: PID 21214 died... 00:55:26.772593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21214): Terminated: ok {rc=0} 00:55:26.817079 --- ParallelTerminationStrategy: PID 21217 died... 00:55:26.835775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21217): Terminated: ok {rc=0} 00:55:26.922829 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 00:55:28.071548 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:28.083394 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:55:28.120829 tst iperf3m4.py: using LAC 37421 00:55:28.240543 tst iperf3m4.py: using RAC 191 00:55:28.361692 tst iperf3m4.py: using CellId 37421 00:55:28.480124 tst iperf3m4.py: using BVCI 37422 00:55:28.592634 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:28.603578 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:28.614289 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:28.624885 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:28.635408 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:28.645878 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:28.656618 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:28.667185 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:28.677918 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:28.800743 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:28.916297 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:29.038700 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:29.155656 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:55:29.377572 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:29.707110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21219): Launched 00:55:29.992128 run iperf3-srv_10.42.42.10(pid=21220): Launched 00:55:30.116272 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:55:30.336731 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:30.666570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21221): Launched 00:55:30.974363 run iperf3-srv_10.42.42.10(pid=21222): Launched 00:55:31.127447 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:55:31.358250 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:31.697701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21223): Launched 00:55:32.000611 run iperf3-srv_10.42.42.10(pid=21224): Launched 00:55:32.140021 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:55:32.360614 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:55:32.689662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21225): Launched 00:55:32.977115 run iperf3-srv_10.42.42.10(pid=21226): Launched 00:55:33.099208 tst iperf3m4.py:8: start network... 00:55:33.317639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:55:33.823224 run create_hlr_db(pid=21227): Launched 00:55:33.947102 bus /gobi_6: Setting Powered False 00:55:35.011992 run create_hlr_db(pid=21227): Terminated: ok {rc=0} 00:55:35.467495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21229): Launched 00:55:35.794722 run osmo-hlr_10.42.42.2(pid=21230): Launched 00:55:35.921488 run osmo-stp_10.42.42.5: Starting osmo-stp 00:55:36.485677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21232): Launched 00:55:36.814818 run osmo-stp_10.42.42.5(pid=21233): Launched 00:55:36.940837 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:55:37.504574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21235): Launched 00:55:37.633656 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:55:37.911311 run patchelf(pid=21236): Launched 00:55:38.094443 run osmo-stp_10.42.42.5(pid=21233): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21233)] 00:55:38.233573 run osmo-stp_10.42.42.5(pid=21233): stdout: | (launched: 2022-12-14_00:55:36.754429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:38.375379 run osmo-stp_10.42.42.5(pid=21233): stderr: | [0;m[38;5;43m20221214005536946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005536946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005536946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005536947 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005536947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005536947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005536947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:38.516591 run osmo-stp_10.42.42.5(pid=21233): stdout: | (launched: 2022-12-14_00:55:36.754429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:38.650519 run osmo-stp_10.42.42.5(pid=21233): stderr: | [0;m[38;5;43m20221214005536946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005536946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005536946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005536947 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005536947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005536947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005536947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:38.809330 run patchelf(pid=21236): Terminating (SIGINT) 00:55:38.992521 run patchelf(pid=21236): Terminated: ok {rc=0} 00:55:39.125072 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21233): Process ended prematurely: osmo-stp_10.42.42.5(pid=21233) [trial-2397↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21233)] [trial-2397↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 00:55:39.135483 tst iperf3m4.py:8: Test FAILED (11.1 sec) 00:55:39.164602 run osmo-hlr_10.42.42.2(pid=21230): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21230)] 00:55:39.215760 run osmo-hlr_10.42.42.2(pid=21230): stdout: | (launched: 2022-12-14_00:55:35.734192) 00:55:39.268126 run osmo-hlr_10.42.42.2(pid=21230): stderr: | [0;m[1;31m20221214005535932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005535932 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005535933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005535933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005535933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005535933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005535945 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005535955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005535955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005535955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:55:39.320668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21219): Terminating (SIGTERM) 00:55:39.362788 run iperf3-srv_10.42.42.10(pid=21220): Terminating (SIGTERM) 00:55:39.405118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21221): Terminating (SIGTERM) 00:55:39.447250 run iperf3-srv_10.42.42.10(pid=21222): Terminating (SIGTERM) 00:55:39.489366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21223): Terminating (SIGTERM) 00:55:39.531548 run iperf3-srv_10.42.42.10(pid=21224): Terminating (SIGTERM) 00:55:39.573507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21225): Terminating (SIGTERM) 00:55:39.615670 run iperf3-srv_10.42.42.10(pid=21226): Terminating (SIGTERM) 00:55:39.657743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21229): Terminating (SIGTERM) 00:55:39.700791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21232): Terminating (SIGTERM) 00:55:39.743001 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21235): Terminating (SIGTERM) 00:55:39.786205 --- ParallelTerminationStrategy: PID 21219 died... 00:55:39.806523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21219): Terminated: ok {rc=0} 00:55:39.852905 --- ParallelTerminationStrategy: PID 21220 died... 00:55:39.873253 run iperf3-srv_10.42.42.10(pid=21220): Terminated {rc=256} 00:55:39.919476 --- ParallelTerminationStrategy: PID 21221 died... 00:55:39.939261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21221): Terminated: ok {rc=0} 00:55:39.986218 --- ParallelTerminationStrategy: PID 21222 died... 00:55:40.005962 run iperf3-srv_10.42.42.10(pid=21222): Terminated {rc=256} 00:55:40.052051 --- ParallelTerminationStrategy: PID 21223 died... 00:55:40.072014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21223): Terminated: ok {rc=0} 00:55:40.118296 --- ParallelTerminationStrategy: PID 21224 died... 00:55:40.138101 run iperf3-srv_10.42.42.10(pid=21224): Terminated {rc=256} 00:55:40.184388 --- ParallelTerminationStrategy: PID 21225 died... 00:55:40.204234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21225): Terminated: ok {rc=0} 00:55:40.250301 --- ParallelTerminationStrategy: PID 21226 died... 00:55:40.270260 run iperf3-srv_10.42.42.10(pid=21226): Terminated {rc=256} 00:55:40.316288 --- ParallelTerminationStrategy: PID 21229 died... 00:55:40.336332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21229): Terminated: ok {rc=0} 00:55:40.382648 --- ParallelTerminationStrategy: PID 21232 died... 00:55:40.402583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21232): Terminated: ok {rc=0} 00:55:40.448837 --- ParallelTerminationStrategy: PID 21235 died... 00:55:40.469290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21235): Terminated: ok {rc=0} 00:55:40.557150 bus /gobi_4: Setting Powered False 00:55:41.655497 bus /gobi_4: Setting Powered False 00:55:42.770231 bus /gobi_1: Setting Powered False 00:55:43.870285 bus /gobi_1: Setting Powered False 00:55:44.985981 bus /gobi_0: Setting Powered False 00:55:46.086190 bus /gobi_0: Setting Powered False 00:55:47.203863 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 00:55:48.309797 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:48.321378 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:55:48.358469 tst ping.py: using LAC 37422 00:55:48.482305 tst ping.py: using RAC 192 00:55:48.599758 tst ping.py: using CellId 37422 00:55:48.715519 tst ping.py: using BVCI 37423 00:55:48.823512 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:48.834395 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:48.844936 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:48.855526 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:48.865997 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:48.877869 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:48.889171 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:48.900305 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:49.015580 tst ping.py:19: start network... 00:55:49.216333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:55:49.679359 run create_hlr_db(pid=21240): Launched 00:55:49.801326 bus /gobi_6: Setting Powered False 00:55:50.861310 run create_hlr_db(pid=21240): Terminated: ok {rc=0} 00:55:51.299919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21242): Launched 00:55:51.623277 run osmo-hlr_10.42.42.2(pid=21243): Launched 00:55:51.747074 run osmo-stp_10.42.42.5: Starting osmo-stp 00:55:52.304750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21245): Launched 00:55:52.628007 run osmo-stp_10.42.42.5(pid=21246): Launched 00:55:52.752198 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:55:53.305996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21248): Launched 00:55:53.429933 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:55:53.701350 run patchelf(pid=21249): Launched 00:55:53.881844 run osmo-stp_10.42.42.5(pid=21246): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21246)] 00:55:54.018566 run osmo-stp_10.42.42.5(pid=21246): stdout: | (launched: 2022-12-14_00:55:52.568453) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:54.156842 run osmo-stp_10.42.42.5(pid=21246): stderr: | [0;m[38;5;43m20221214005552762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005552762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005552762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005552763 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005552763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005552763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005552763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:54.295602 run osmo-stp_10.42.42.5(pid=21246): stdout: | (launched: 2022-12-14_00:55:52.568453) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:55:54.428382 run osmo-stp_10.42.42.5(pid=21246): stderr: | [0;m[38;5;43m20221214005552762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005552762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005552762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005552763 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005552763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005552763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005552763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:55:54.584795 run patchelf(pid=21249): Terminating (SIGINT) 00:55:54.765139 run patchelf(pid=21249): Terminated: ok {rc=0} 00:55:54.895178 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21246): Process ended prematurely: osmo-stp_10.42.42.5(pid=21246) [trial-2397↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21246)] [trial-2397↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 00:55:54.904744 tst ping.py:22: Test FAILED (6.6 sec) 00:55:54.932883 run osmo-hlr_10.42.42.2(pid=21243): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21243)] 00:55:54.983460 run osmo-hlr_10.42.42.2(pid=21243): stdout: | (launched: 2022-12-14_00:55:51.563947) 00:55:55.035340 run osmo-hlr_10.42.42.2(pid=21243): stderr: | [0;m[1;31m20221214005551762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005551762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005551763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005551763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005551763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005551763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005551775 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005551783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005551783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005551783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:55:55.087843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21242): Terminating (SIGTERM) 00:55:55.129539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21245): Terminating (SIGTERM) 00:55:55.172124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21248): Terminating (SIGTERM) 00:55:55.214526 --- ParallelTerminationStrategy: PID 21242 died... 00:55:55.234897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21242): Terminated: ok {rc=0} 00:55:55.281392 --- ParallelTerminationStrategy: PID 21245 died... 00:55:55.301331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21245): Terminated: ok {rc=0} 00:55:55.347588 --- ParallelTerminationStrategy: PID 21248 died... 00:55:55.367877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21248): Terminated: ok {rc=0} 00:55:55.456599 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 00:55:56.545423 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:56.556772 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:55:56.594613 tst ping_idle_ping.py: using LAC 37423 00:55:56.712657 tst ping_idle_ping.py: using RAC 193 00:55:56.829905 tst ping_idle_ping.py: using CellId 37423 00:55:56.948278 tst ping_idle_ping.py: using BVCI 37424 00:55:57.058425 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:57.069276 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:57.079903 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:57.090654 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:57.101227 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:57.112030 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:57.123130 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:55:57.133802 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:55:57.249105 tst ping_idle_ping.py:24: start network... 00:55:57.449139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:55:57.916424 run create_hlr_db(pid=21250): Launched 00:55:58.040426 bus /gobi_6: Setting Powered False 00:55:59.100816 run create_hlr_db(pid=21250): Terminated: ok {rc=0} 00:55:59.544761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21252): Launched 00:55:59.870605 run osmo-hlr_10.42.42.2(pid=21253): Launched 00:55:59.995209 run osmo-stp_10.42.42.5: Starting osmo-stp 00:56:00.552561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21255): Launched 00:56:00.886028 run osmo-stp_10.42.42.5(pid=21256): Launched 00:56:01.043004 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:56:01.738486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21258): Launched 00:56:01.875174 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:56:02.157702 run patchelf(pid=21259): Launched 00:56:02.368229 run osmo-stp_10.42.42.5(pid=21256): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21256)] 00:56:02.505239 run osmo-stp_10.42.42.5(pid=21256): stdout: | (launched: 2022-12-14_00:56:00.818124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:02.643578 run osmo-stp_10.42.42.5(pid=21256): stderr: | [0;m[38;5;43m20221214005601139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005601139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005601140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005601140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005601143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005601144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005601144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:02.782502 run osmo-stp_10.42.42.5(pid=21256): stdout: | (launched: 2022-12-14_00:56:00.818124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:02.914405 run osmo-stp_10.42.42.5(pid=21256): stderr: | [0;m[38;5;43m20221214005601139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005601139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005601140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005601140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005601143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005601144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005601144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:03.071446 run patchelf(pid=21259): Terminating (SIGINT) 00:56:03.252242 run patchelf(pid=21259): Terminated: ok {rc=0} 00:56:03.382778 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21256): Process ended prematurely: osmo-stp_10.42.42.5(pid=21256) [trial-2397↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21256)] [trial-2397↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 00:56:03.392560 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 00:56:03.421044 run osmo-hlr_10.42.42.2(pid=21253): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21253)] 00:56:03.472420 run osmo-hlr_10.42.42.2(pid=21253): stdout: | (launched: 2022-12-14_00:55:59.810867) 00:56:03.524803 run osmo-hlr_10.42.42.2(pid=21253): stderr: | [0;m[1;31m20221214005600008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005600008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005600008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005600008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005600008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005600008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005600024 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005600033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005600034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005600034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:56:03.577678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21252): Terminating (SIGTERM) 00:56:03.619549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21255): Terminating (SIGTERM) 00:56:03.662008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21258): Terminating (SIGTERM) 00:56:03.704519 --- ParallelTerminationStrategy: PID 21252 died... 00:56:03.725244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21252): Terminated: ok {rc=0} 00:56:03.772066 --- ParallelTerminationStrategy: PID 21255 died... 00:56:03.792122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21255): Terminated: ok {rc=0} 00:56:03.839147 --- ParallelTerminationStrategy: PID 21258 died... 00:56:03.859306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21258): Terminated: ok {rc=0} 00:56:03.949018 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 00:56:05.241392 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:56:05.247800 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 00:56:05.268621 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 00:56:05.307624 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 00:56:05.394502 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 00:56:05.414884 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 00:56:05.452619 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 00:56:06.051044 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 00:56:06.104774 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:06.116161 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:56:06.174236 tst cs_paging_gprs_active.py: using LAC 37424 00:56:06.302516 tst cs_paging_gprs_active.py: using RAC 194 00:56:06.433115 tst cs_paging_gprs_active.py: using CellId 37424 00:56:06.562552 tst cs_paging_gprs_active.py: using BVCI 37425 00:56:06.681788 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:06.693264 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:06.704250 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:06.715392 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:06.726738 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:06.738110 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:06.749606 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:06.761305 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:06.772715 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:06.890035 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:07.011001 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:56:07.234116 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:07.566245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21264): Launched 00:56:07.854024 run iperf3-srv_10.42.42.10(pid=21265): Launched 00:56:07.977814 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:56:08.199880 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:08.531737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21266): Launched 00:56:08.821502 run iperf3-srv_10.42.42.10(pid=21267): Launched 00:56:08.945633 tst cs_paging_gprs_active.py:38: start network... 00:56:09.169054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:56:09.680065 run create_hlr_db(pid=21268): Launched 00:56:09.805283 bus /gobi_6: Setting Powered False 00:56:10.869743 run create_hlr_db(pid=21268): Terminated: ok {rc=0} 00:56:11.327409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21270): Launched 00:56:11.658987 run osmo-hlr_10.42.42.2(pid=21271): Launched 00:56:11.786655 run osmo-stp_10.42.42.5: Starting osmo-stp 00:56:12.356382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21273): Launched 00:56:12.672250 run osmo-stp_10.42.42.5(pid=21274): Launched 00:56:12.790429 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:56:13.322795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21276): Launched 00:56:13.442027 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:56:13.701446 run patchelf(pid=21277): Launched 00:56:13.872503 run osmo-stp_10.42.42.5(pid=21274): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21274)] 00:56:14.002582 run osmo-stp_10.42.42.5(pid=21274): stdout: | (launched: 2022-12-14_00:56:12.615196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:14.134189 run osmo-stp_10.42.42.5(pid=21274): stderr: | [0;m[38;5;43m20221214005612786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005612786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005612787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005612787 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005612787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005612787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005612788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:14.265914 run osmo-stp_10.42.42.5(pid=21274): stdout: | (launched: 2022-12-14_00:56:12.615196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:14.391226 run osmo-stp_10.42.42.5(pid=21274): stderr: | [0;m[38;5;43m20221214005612786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005612786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005612787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005612787 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005612787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005612787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005612788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:14.540751 run patchelf(pid=21277): Terminating (SIGINT) 00:56:14.713690 run patchelf(pid=21277): Terminated: ok {rc=0} 00:56:14.838080 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21274): Process ended prematurely: osmo-stp_10.42.42.5(pid=21274) [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21274)] [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 00:56:14.847388 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 00:56:14.874584 run osmo-hlr_10.42.42.2(pid=21271): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21271)] 00:56:14.921831 run osmo-hlr_10.42.42.2(pid=21271): stdout: | (launched: 2022-12-14_00:56:11.598474) 00:56:14.970751 run osmo-hlr_10.42.42.2(pid=21271): stderr: | [0;m[1;31m20221214005611797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005611797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005611797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005611798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005611798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005611798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005611810 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005611818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005611818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005611818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:56:15.020296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21264): Terminating (SIGTERM) 00:56:15.059677 run iperf3-srv_10.42.42.10(pid=21265): Terminating (SIGTERM) 00:56:15.098934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21266): Terminating (SIGTERM) 00:56:15.138443 run iperf3-srv_10.42.42.10(pid=21267): Terminating (SIGTERM) 00:56:15.177755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21270): Terminating (SIGTERM) 00:56:15.217345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21273): Terminating (SIGTERM) 00:56:15.256693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21276): Terminating (SIGTERM) 00:56:15.296203 --- ParallelTerminationStrategy: PID 21264 died... 00:56:15.315255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21264): Terminated: ok {rc=0} 00:56:15.358710 --- ParallelTerminationStrategy: PID 21265 died... 00:56:15.377116 run iperf3-srv_10.42.42.10(pid=21265): Terminated {rc=256} 00:56:15.420102 --- ParallelTerminationStrategy: PID 21266 died... 00:56:15.438426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21266): Terminated: ok {rc=0} 00:56:15.481383 --- ParallelTerminationStrategy: PID 21267 died... 00:56:15.499640 run iperf3-srv_10.42.42.10(pid=21267): Terminated {rc=256} 00:56:15.542563 --- ParallelTerminationStrategy: PID 21270 died... 00:56:15.561100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21270): Terminated: ok {rc=0} 00:56:15.603958 --- ParallelTerminationStrategy: PID 21273 died... 00:56:15.622275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21273): Terminated: ok {rc=0} 00:56:15.665412 --- ParallelTerminationStrategy: PID 21276 died... 00:56:15.683765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21276): Terminated: ok {rc=0} 00:56:15.769458 bus /gobi_0: Setting Powered False 00:56:16.873513 bus /gobi_0: Setting Powered False 00:56:17.988382 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 00:56:19.137279 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:19.149273 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:56:19.210162 tst iperf3.py: using LAC 37425 00:56:19.339336 tst iperf3.py: using RAC 195 00:56:19.461440 tst iperf3.py: using CellId 37425 00:56:19.580459 tst iperf3.py: using BVCI 37426 00:56:19.691045 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:19.701972 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:19.712532 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:19.723119 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:19.733639 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:19.744192 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:19.756224 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:19.766901 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:19.777641 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:19.897849 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:56:20.118750 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:20.448328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21278): Launched 00:56:20.734167 run iperf3-srv_10.42.42.10(pid=21279): Launched 00:56:20.858188 tst iperf3.py:8: start network... 00:56:21.078406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:56:21.584044 run create_hlr_db(pid=21280): Launched 00:56:21.710187 bus /gobi_6: Setting Powered False 00:56:22.774500 run create_hlr_db(pid=21280): Terminated: ok {rc=0} 00:56:23.211203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21282): Launched 00:56:23.516704 run osmo-hlr_10.42.42.2(pid=21283): Launched 00:56:23.632676 run osmo-stp_10.42.42.5: Starting osmo-stp 00:56:24.158216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21285): Launched 00:56:24.462576 run osmo-stp_10.42.42.5(pid=21286): Launched 00:56:24.580177 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:56:25.106515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21288): Launched 00:56:25.223098 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:56:25.480008 run patchelf(pid=21289): Launched 00:56:25.648766 run osmo-stp_10.42.42.5(pid=21286): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21286)] 00:56:25.777237 run osmo-stp_10.42.42.5(pid=21286): stdout: | (launched: 2022-12-14_00:56:24.405878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:25.907852 run osmo-stp_10.42.42.5(pid=21286): stderr: | [0;m[38;5;43m20221214005624576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005624576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005624576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005624577 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005624577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005624577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005624577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:26.039305 run osmo-stp_10.42.42.5(pid=21286): stdout: | (launched: 2022-12-14_00:56:24.405878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:26.163095 run osmo-stp_10.42.42.5(pid=21286): stderr: | [0;m[38;5;43m20221214005624576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005624576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005624576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005624577 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005624577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005624577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005624577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:26.310186 run patchelf(pid=21289): Terminating (SIGINT) 00:56:26.480189 run patchelf(pid=21289): Terminated: ok {rc=0} 00:56:26.603960 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21286): Process ended prematurely: osmo-stp_10.42.42.5(pid=21286) [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21286)] [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 00:56:26.613647 tst iperf3.py:8: Test FAILED (7.5 sec) 00:56:26.640505 run osmo-hlr_10.42.42.2(pid=21283): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21283)] 00:56:26.687526 run osmo-hlr_10.42.42.2(pid=21283): stdout: | (launched: 2022-12-14_00:56:23.460095) 00:56:26.736639 run osmo-hlr_10.42.42.2(pid=21283): stderr: | [0;m[1;31m20221214005623635 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005623636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005623636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005623636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005623636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005623636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005623657 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005623667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005623667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005623667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:56:26.785838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21278): Terminating (SIGTERM) 00:56:26.824929 run iperf3-srv_10.42.42.10(pid=21279): Terminating (SIGTERM) 00:56:26.864100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21282): Terminating (SIGTERM) 00:56:26.903258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21285): Terminating (SIGTERM) 00:56:26.942281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21288): Terminating (SIGTERM) 00:56:26.981497 --- ParallelTerminationStrategy: PID 21278 died... 00:56:27.000259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21278): Terminated: ok {rc=0} 00:56:27.044841 --- ParallelTerminationStrategy: PID 21279 died... 00:56:27.063325 run iperf3-srv_10.42.42.10(pid=21279): Terminated {rc=256} 00:56:27.106694 --- ParallelTerminationStrategy: PID 21282 died... 00:56:27.124942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21282): Terminated: ok {rc=0} 00:56:27.168104 --- ParallelTerminationStrategy: PID 21285 died... 00:56:27.186430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21285): Terminated: ok {rc=0} 00:56:27.229750 --- ParallelTerminationStrategy: PID 21288 died... 00:56:27.248280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21288): Terminated: ok {rc=0} 00:56:27.332299 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 00:56:28.475827 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:28.487464 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:56:28.544713 tst iperf3m4.py: using LAC 37426 00:56:28.666347 tst iperf3m4.py: using RAC 196 00:56:28.785112 tst iperf3m4.py: using CellId 37426 00:56:28.904358 tst iperf3m4.py: using BVCI 37427 00:56:29.015915 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:29.026947 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:29.037686 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:29.048307 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:29.058879 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:29.069492 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:29.080645 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:29.091188 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:29.102065 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:29.224590 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:29.344173 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:29.465841 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:29.587117 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:56:29.791501 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:30.099644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21290): Launched 00:56:30.367431 run iperf3-srv_10.42.42.10(pid=21291): Launched 00:56:30.482304 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:56:30.686360 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:31.015726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21292): Launched 00:56:31.301320 run iperf3-srv_10.42.42.10(pid=21293): Launched 00:56:31.443357 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:56:31.673621 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:32.013102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21294): Launched 00:56:32.314804 run iperf3-srv_10.42.42.10(pid=21295): Launched 00:56:32.440050 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:56:32.661485 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:56:32.992239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21296): Launched 00:56:33.280834 run iperf3-srv_10.42.42.10(pid=21297): Launched 00:56:33.404717 tst iperf3m4.py:8: start network... 00:56:33.625508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:56:34.133989 run create_hlr_db(pid=21298): Launched 00:56:34.260822 bus /gobi_6: Setting Powered False 00:56:35.325445 run create_hlr_db(pid=21298): Terminated: ok {rc=0} 00:56:35.783599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21300): Launched 00:56:36.114874 run osmo-hlr_10.42.42.2(pid=21301): Launched 00:56:36.241960 run osmo-stp_10.42.42.5: Starting osmo-stp 00:56:36.809246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21303): Launched 00:56:37.137707 run osmo-stp_10.42.42.5(pid=21304): Launched 00:56:37.264160 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:56:37.831772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21306): Launched 00:56:37.958294 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:56:38.236168 run patchelf(pid=21307): Launched 00:56:38.421439 run osmo-stp_10.42.42.5(pid=21304): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21304)] 00:56:38.560163 run osmo-stp_10.42.42.5(pid=21304): stdout: | (launched: 2022-12-14_00:56:37.077276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:38.701856 run osmo-stp_10.42.42.5(pid=21304): stderr: | [0;m[38;5;43m20221214005637268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005637268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005637268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005637270 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005637270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005637270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005637270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:38.843427 run osmo-stp_10.42.42.5(pid=21304): stdout: | (launched: 2022-12-14_00:56:37.077276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:38.977750 run osmo-stp_10.42.42.5(pid=21304): stderr: | [0;m[38;5;43m20221214005637268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005637268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005637268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005637270 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005637270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005637270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005637270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:39.137203 run patchelf(pid=21307): Terminating (SIGINT) 00:56:39.320791 run patchelf(pid=21307): Terminated: ok {rc=0} 00:56:39.454205 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21304): Process ended prematurely: osmo-stp_10.42.42.5(pid=21304) [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21304)] [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 00:56:39.464415 tst iperf3m4.py:8: Test FAILED (11.0 sec) 00:56:39.493416 run osmo-hlr_10.42.42.2(pid=21301): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21301)] 00:56:39.544203 run osmo-hlr_10.42.42.2(pid=21301): stdout: | (launched: 2022-12-14_00:56:36.053882) 00:56:39.597162 run osmo-hlr_10.42.42.2(pid=21301): stderr: | [0;m[1;31m20221214005636251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005636251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005636252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005636252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005636252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005636252 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005636266 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005636277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005636277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005636277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:56:39.649643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21290): Terminating (SIGTERM) 00:56:39.691669 run iperf3-srv_10.42.42.10(pid=21291): Terminating (SIGTERM) 00:56:39.733889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21292): Terminating (SIGTERM) 00:56:39.776672 run iperf3-srv_10.42.42.10(pid=21293): Terminating (SIGTERM) 00:56:39.819050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21294): Terminating (SIGTERM) 00:56:39.861469 run iperf3-srv_10.42.42.10(pid=21295): Terminating (SIGTERM) 00:56:39.903930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21296): Terminating (SIGTERM) 00:56:39.946152 run iperf3-srv_10.42.42.10(pid=21297): Terminating (SIGTERM) 00:56:39.988124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21300): Terminating (SIGTERM) 00:56:40.030406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21303): Terminating (SIGTERM) 00:56:40.072534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21306): Terminating (SIGTERM) 00:56:40.115185 --- ParallelTerminationStrategy: PID 21290 died... 00:56:40.135751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21290): Terminated: ok {rc=0} 00:56:40.182588 --- ParallelTerminationStrategy: PID 21291 died... 00:56:40.202536 run iperf3-srv_10.42.42.10(pid=21291): Terminated {rc=256} 00:56:40.249489 --- ParallelTerminationStrategy: PID 21292 died... 00:56:40.269428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21292): Terminated: ok {rc=0} 00:56:40.316075 --- ParallelTerminationStrategy: PID 21293 died... 00:56:40.336237 run iperf3-srv_10.42.42.10(pid=21293): Terminated {rc=256} 00:56:40.383130 --- ParallelTerminationStrategy: PID 21294 died... 00:56:40.403071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21294): Terminated: ok {rc=0} 00:56:40.449803 --- ParallelTerminationStrategy: PID 21295 died... 00:56:40.469661 run iperf3-srv_10.42.42.10(pid=21295): Terminated {rc=256} 00:56:40.516139 --- ParallelTerminationStrategy: PID 21296 died... 00:56:40.536148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21296): Terminated: ok {rc=0} 00:56:40.582520 --- ParallelTerminationStrategy: PID 21297 died... 00:56:40.602667 run iperf3-srv_10.42.42.10(pid=21297): Terminated {rc=256} 00:56:40.648914 --- ParallelTerminationStrategy: PID 21300 died... 00:56:40.669880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21300): Terminated: ok {rc=0} 00:56:40.716604 --- ParallelTerminationStrategy: PID 21303 died... 00:56:40.736800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21303): Terminated: ok {rc=0} 00:56:40.783195 --- ParallelTerminationStrategy: PID 21306 died... 00:56:40.803233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21306): Terminated: ok {rc=0} 00:56:40.892045 bus /gobi_4: Setting Powered False 00:56:41.992828 bus /gobi_4: Setting Powered False 00:56:43.108637 bus /gobi_1: Setting Powered False 00:56:44.207365 bus /gobi_1: Setting Powered False 00:56:45.326437 bus /gobi_0: Setting Powered False 00:56:46.427596 bus /gobi_0: Setting Powered False 00:56:47.549544 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 00:56:48.656744 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:48.669126 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:56:48.730590 tst ping.py: using LAC 37427 00:56:48.858275 tst ping.py: using RAC 197 00:56:48.984486 tst ping.py: using CellId 37427 00:56:49.110855 tst ping.py: using BVCI 37428 00:56:49.229793 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:49.241480 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:49.252757 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:49.264027 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:49.275661 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:49.287137 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:49.298997 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:49.310652 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:49.426846 tst ping.py:19: start network... 00:56:49.629794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:56:50.099084 run create_hlr_db(pid=21308): Launched 00:56:50.222652 bus /gobi_6: Setting Powered False 00:56:51.282534 run create_hlr_db(pid=21308): Terminated: ok {rc=0} 00:56:51.705431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21310): Launched 00:56:52.008517 run osmo-hlr_10.42.42.2(pid=21311): Launched 00:56:52.122806 run osmo-stp_10.42.42.5: Starting osmo-stp 00:56:52.643839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21313): Launched 00:56:52.945659 run osmo-stp_10.42.42.5(pid=21314): Launched 00:56:53.060036 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:56:53.582679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21316): Launched 00:56:53.699514 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:56:53.953468 run patchelf(pid=21317): Launched 00:56:54.121331 run osmo-stp_10.42.42.5(pid=21314): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21314)] 00:56:54.249319 run osmo-stp_10.42.42.5(pid=21314): stdout: | (launched: 2022-12-14_00:56:52.889561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:54.379010 run osmo-stp_10.42.42.5(pid=21314): stderr: | [0;m[38;5;43m20221214005653059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005653059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005653060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005653060 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005653061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005653061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005653061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:54.508607 run osmo-stp_10.42.42.5(pid=21314): stdout: | (launched: 2022-12-14_00:56:52.889561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:56:54.631973 run osmo-stp_10.42.42.5(pid=21314): stderr: | [0;m[38;5;43m20221214005653059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005653059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005653060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005653060 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005653061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005653061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005653061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:56:54.778683 run patchelf(pid=21317): Terminating (SIGINT) 00:56:54.947937 run patchelf(pid=21317): Terminated: ok {rc=0} 00:56:55.069249 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21314): Process ended prematurely: osmo-stp_10.42.42.5(pid=21314) [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21314)] [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 00:56:55.078689 tst ping.py:22: Test FAILED (6.4 sec) 00:56:55.105611 run osmo-hlr_10.42.42.2(pid=21311): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21311)] 00:56:55.153521 run osmo-hlr_10.42.42.2(pid=21311): stdout: | (launched: 2022-12-14_00:56:51.952221) 00:56:55.203305 run osmo-hlr_10.42.42.2(pid=21311): stderr: | [0;m[1;31m20221214005652130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005652130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005652130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005652130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005652130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005652130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005652159 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005652168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005652169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005652169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:56:55.253485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21310): Terminating (SIGTERM) 00:56:55.293609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21313): Terminating (SIGTERM) 00:56:55.333813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21316): Terminating (SIGTERM) 00:56:55.374253 --- ParallelTerminationStrategy: PID 21310 died... 00:56:55.393627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21310): Terminated: ok {rc=0} 00:56:55.437872 --- ParallelTerminationStrategy: PID 21313 died... 00:56:55.456601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21313): Terminated: ok {rc=0} 00:56:55.500495 --- ParallelTerminationStrategy: PID 21316 died... 00:56:55.519305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21316): Terminated: ok {rc=0} 00:56:55.605406 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 00:56:56.694190 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:56.705856 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:56:56.764026 tst ping_idle_ping.py: using LAC 37428 00:56:56.884501 tst ping_idle_ping.py: using RAC 198 00:56:57.005380 tst ping_idle_ping.py: using CellId 37428 00:56:57.125346 tst ping_idle_ping.py: using BVCI 37429 00:56:57.235549 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:57.246539 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:57.257225 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:57.267832 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:57.278403 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:57.289018 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:57.299872 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:56:57.310575 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:56:57.430332 tst ping_idle_ping.py:24: start network... 00:56:57.650016 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:56:58.153972 run create_hlr_db(pid=21318): Launched 00:56:58.279433 bus /gobi_6: Setting Powered False 00:56:59.343999 run create_hlr_db(pid=21318): Terminated: ok {rc=0} 00:56:59.780794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21320): Launched 00:57:00.083694 run osmo-hlr_10.42.42.2(pid=21321): Launched 00:57:00.198574 run osmo-stp_10.42.42.5: Starting osmo-stp 00:57:00.717899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21323): Launched 00:57:01.067199 run osmo-stp_10.42.42.5(pid=21324): Launched 00:57:01.277452 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:57:01.879163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21326): Launched 00:57:02.003777 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:57:02.269694 run patchelf(pid=21327): Launched 00:57:02.465510 run osmo-stp_10.42.42.5(pid=21324): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21324)] 00:57:02.603186 run osmo-stp_10.42.42.5(pid=21324): stdout: | (launched: 2022-12-14_00:57:01.004418) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:02.742396 run osmo-stp_10.42.42.5(pid=21324): stderr: | [0;m[38;5;43m20221214005701366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005701366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005701366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005701367 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005701367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005701367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005701367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:02.881698 run osmo-stp_10.42.42.5(pid=21324): stdout: | (launched: 2022-12-14_00:57:01.004418) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:03.014134 run osmo-stp_10.42.42.5(pid=21324): stderr: | [0;m[38;5;43m20221214005701366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005701366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005701366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005701367 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005701367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005701367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005701367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:03.171487 run patchelf(pid=21327): Terminating (SIGINT) 00:57:03.352637 run patchelf(pid=21327): Terminated: ok {rc=0} 00:57:03.483563 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21324): Process ended prematurely: osmo-stp_10.42.42.5(pid=21324) [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21324)] [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 00:57:03.493393 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 00:57:03.521940 run osmo-hlr_10.42.42.2(pid=21321): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21321)] 00:57:03.573646 run osmo-hlr_10.42.42.2(pid=21321): stdout: | (launched: 2022-12-14_00:57:00.027379) 00:57:03.627302 run osmo-hlr_10.42.42.2(pid=21321): stderr: | [0;m[1;31m20221214005700199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005700199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005700199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005700199 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005700200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005700200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005700233 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005700243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005700243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005700243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:57:03.680831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21320): Terminating (SIGTERM) 00:57:03.723528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21323): Terminating (SIGTERM) 00:57:03.766619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21326): Terminating (SIGTERM) 00:57:03.809654 --- ParallelTerminationStrategy: PID 21320 died... 00:57:03.830567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21320): Terminated: ok {rc=0} 00:57:03.877970 --- ParallelTerminationStrategy: PID 21323 died... 00:57:03.898183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21323): Terminated: ok {rc=0} 00:57:03.945478 --- ParallelTerminationStrategy: PID 21326 died... 00:57:03.965886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21326): Terminated: ok {rc=0} 00:57:04.055671 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:57:05.358359 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:57:05.364721 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:57:05.385497 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 00:57:05.424015 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 00:57:05.510005 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:57:05.530401 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 00:57:05.567941 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 00:57:06.162907 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 00:57:06.211650 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:06.222632 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:57:06.279714 tst cs_paging_gprs_active.py: using LAC 37429 00:57:06.405992 tst cs_paging_gprs_active.py: using RAC 199 00:57:06.529489 tst cs_paging_gprs_active.py: using CellId 37429 00:57:06.658739 tst cs_paging_gprs_active.py: using BVCI 37430 00:57:06.778112 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:06.789755 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:06.800891 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:06.812157 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:06.823428 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:06.834842 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:06.846407 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:06.857735 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:06.869301 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:06.986963 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:07.106401 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:57:07.329818 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:57:07.661641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21332): Launched 00:57:07.950651 run iperf3-srv_10.42.42.10(pid=21333): Launched 00:57:08.075652 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:57:08.297473 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:57:08.628116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21334): Launched 00:57:08.916634 run iperf3-srv_10.42.42.10(pid=21335): Launched 00:57:09.042141 tst cs_paging_gprs_active.py:38: start network... 00:57:09.264057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:57:09.774092 run create_hlr_db(pid=21336): Launched 00:57:09.900628 bus /gobi_6: Setting Powered False 00:57:10.965890 run create_hlr_db(pid=21336): Terminated: ok {rc=0} 00:57:11.423574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21338): Launched 00:57:11.754993 run osmo-hlr_10.42.42.2(pid=21339): Launched 00:57:11.882440 run osmo-stp_10.42.42.5: Starting osmo-stp 00:57:12.452219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21341): Launched 00:57:12.783520 run osmo-stp_10.42.42.5(pid=21342): Launched 00:57:12.910603 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:57:13.477798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21344): Launched 00:57:13.604155 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:57:13.881950 run patchelf(pid=21345): Launched 00:57:14.065351 run osmo-stp_10.42.42.5(pid=21342): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21342)] 00:57:14.204316 run osmo-stp_10.42.42.5(pid=21342): stdout: | (launched: 2022-12-14_00:57:12.723168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:14.344714 run osmo-stp_10.42.42.5(pid=21342): stderr: | [0;m[38;5;43m20221214005712916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005712916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005712916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005712917 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005712917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005712917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005712917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:14.485931 run osmo-stp_10.42.42.5(pid=21342): stdout: | (launched: 2022-12-14_00:57:12.723168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:14.620226 run osmo-stp_10.42.42.5(pid=21342): stderr: | [0;m[38;5;43m20221214005712916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005712916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005712916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005712917 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005712917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005712917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005712917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:14.779423 run patchelf(pid=21345): Terminating (SIGINT) 00:57:14.963693 run patchelf(pid=21345): Terminated: ok {rc=0} 00:57:15.096414 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21342): Process ended prematurely: osmo-stp_10.42.42.5(pid=21342) [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21342)] [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 00:57:15.106957 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 00:57:15.135567 run osmo-hlr_10.42.42.2(pid=21339): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21339)] 00:57:15.186449 run osmo-hlr_10.42.42.2(pid=21339): stdout: | (launched: 2022-12-14_00:57:11.694342) 00:57:15.239314 run osmo-hlr_10.42.42.2(pid=21339): stderr: | [0;m[1;31m20221214005711893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005711893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005711893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005711893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005711893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005711893 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005711906 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005711914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005711914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005711914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:57:15.291641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21332): Terminating (SIGTERM) 00:57:15.333898 run iperf3-srv_10.42.42.10(pid=21333): Terminating (SIGTERM) 00:57:15.375824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21334): Terminating (SIGTERM) 00:57:15.418859 run iperf3-srv_10.42.42.10(pid=21335): Terminating (SIGTERM) 00:57:15.461175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21338): Terminating (SIGTERM) 00:57:15.503854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21341): Terminating (SIGTERM) 00:57:15.545990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21344): Terminating (SIGTERM) 00:57:15.588513 --- ParallelTerminationStrategy: PID 21332 died... 00:57:15.608737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21332): Terminated: ok {rc=0} 00:57:15.654964 --- ParallelTerminationStrategy: PID 21333 died... 00:57:15.674601 run iperf3-srv_10.42.42.10(pid=21333): Terminated {rc=256} 00:57:15.720452 --- ParallelTerminationStrategy: PID 21334 died... 00:57:15.740203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21334): Terminated: ok {rc=0} 00:57:15.786324 --- ParallelTerminationStrategy: PID 21335 died... 00:57:15.806036 run iperf3-srv_10.42.42.10(pid=21335): Terminated {rc=256} 00:57:15.868237 --- ParallelTerminationStrategy: PID 21338 died... 00:57:15.900030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21338): Terminated: ok {rc=0} 00:57:15.953998 --- ParallelTerminationStrategy: PID 21341 died... 00:57:15.981199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21341): Terminated: ok {rc=0} 00:57:16.032329 --- ParallelTerminationStrategy: PID 21344 died... 00:57:16.052802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21344): Terminated: ok {rc=0} 00:57:16.142775 bus /gobi_0: Setting Powered False 00:57:17.240532 bus /gobi_0: Setting Powered False 00:57:18.355748 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 00:57:19.502046 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:19.513759 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:57:19.573848 tst iperf3.py: using LAC 37430 00:57:19.702875 tst iperf3.py: using RAC 200 00:57:19.831289 tst iperf3.py: using CellId 37430 00:57:19.959665 tst iperf3.py: using BVCI 37431 00:57:20.078128 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:20.089697 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:20.100719 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:20.111892 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:20.123232 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:20.134715 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:20.146314 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:20.157666 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:20.169289 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:20.286506 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:57:20.507970 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:57:20.837736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21346): Launched 00:57:21.127073 run iperf3-srv_10.42.42.10(pid=21347): Launched 00:57:21.251367 tst iperf3.py:8: start network... 00:57:21.472257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:57:21.979709 run create_hlr_db(pid=21348): Launched 00:57:22.107203 bus /gobi_6: Setting Powered False 00:57:23.171589 run create_hlr_db(pid=21348): Terminated: ok {rc=0} 00:57:23.628261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21350): Launched 00:57:23.957642 run osmo-hlr_10.42.42.2(pid=21351): Launched 00:57:24.084695 run osmo-stp_10.42.42.5: Starting osmo-stp 00:57:24.648438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21353): Launched 00:57:24.977961 run osmo-stp_10.42.42.5(pid=21354): Launched 00:57:25.105488 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:57:25.672864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21356): Launched 00:57:25.800507 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:57:26.078448 run patchelf(pid=21357): Launched 00:57:26.262867 run osmo-stp_10.42.42.5(pid=21354): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21354)] 00:57:26.402270 run osmo-stp_10.42.42.5(pid=21354): stdout: | (launched: 2022-12-14_00:57:24.917865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:26.543518 run osmo-stp_10.42.42.5(pid=21354): stderr: | [0;m[38;5;43m20221214005725110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005725110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005725111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005725111 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005725112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005725112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005725112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:26.684763 run osmo-stp_10.42.42.5(pid=21354): stdout: | (launched: 2022-12-14_00:57:24.917865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:26.818959 run osmo-stp_10.42.42.5(pid=21354): stderr: | [0;m[38;5;43m20221214005725110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005725110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005725111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005725111 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005725112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005725112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005725112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:26.978149 run patchelf(pid=21357): Terminating (SIGINT) 00:57:27.162007 run patchelf(pid=21357): Terminated: ok {rc=0} 00:57:27.295163 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21354): Process ended prematurely: osmo-stp_10.42.42.5(pid=21354) [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21354)] [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 00:57:27.305766 tst iperf3.py:8: Test FAILED (7.8 sec) 00:57:27.334175 run osmo-hlr_10.42.42.2(pid=21351): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21351)] 00:57:27.384773 run osmo-hlr_10.42.42.2(pid=21351): stdout: | (launched: 2022-12-14_00:57:23.897554) 00:57:27.437297 run osmo-hlr_10.42.42.2(pid=21351): stderr: | [0;m[1;31m20221214005724095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005724095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005724095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005724095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005724095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005724095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005724107 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005724115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005724116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005724116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:57:27.489729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21346): Terminating (SIGTERM) 00:57:27.531251 run iperf3-srv_10.42.42.10(pid=21347): Terminating (SIGTERM) 00:57:27.574032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21350): Terminating (SIGTERM) 00:57:27.613727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21353): Terminating (SIGTERM) 00:57:27.653146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21356): Terminating (SIGTERM) 00:57:27.693361 --- ParallelTerminationStrategy: PID 21346 died... 00:57:27.712540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21346): Terminated: ok {rc=0} 00:57:27.757120 --- ParallelTerminationStrategy: PID 21347 died... 00:57:27.775878 run iperf3-srv_10.42.42.10(pid=21347): Terminated {rc=256} 00:57:27.819345 --- ParallelTerminationStrategy: PID 21350 died... 00:57:27.837908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21350): Terminated: ok {rc=0} 00:57:27.881196 --- ParallelTerminationStrategy: PID 21353 died... 00:57:27.899731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21353): Terminated: ok {rc=0} 00:57:27.943328 --- ParallelTerminationStrategy: PID 21356 died... 00:57:27.962123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21356): Terminated: ok {rc=0} 00:57:28.048535 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 00:57:29.198126 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:29.209836 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:57:29.266891 tst iperf3m4.py: using LAC 37431 00:57:29.389098 tst iperf3m4.py: using RAC 201 00:57:29.510580 tst iperf3m4.py: using CellId 37431 00:57:29.632542 tst iperf3m4.py: using BVCI 37432 00:57:29.745386 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:29.756257 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:29.766967 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:29.777677 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:29.788181 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:29.798836 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:29.809715 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:29.820242 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:29.831055 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:29.953680 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:30.072547 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:30.192121 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:30.311664 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:57:30.534991 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:57:30.877775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21359): Launched 00:57:31.209016 run iperf3-srv_10.42.42.10(pid=21360): Launched 00:57:31.343081 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:57:31.557183 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:57:31.874464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21361): Launched 00:57:32.166473 run iperf3-srv_10.42.42.10(pid=21362): Launched 00:57:32.307996 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:57:32.512401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:57:32.820584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21363): Launched 00:57:33.089943 run iperf3-srv_10.42.42.10(pid=21364): Launched 00:57:33.204597 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:57:33.408132 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:57:33.715298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21365): Launched 00:57:33.982473 run iperf3-srv_10.42.42.10(pid=21366): Launched 00:57:34.098889 tst iperf3m4.py:8: start network... 00:57:34.302895 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:57:34.776276 run create_hlr_db(pid=21367): Launched 00:57:34.901722 bus /gobi_6: Setting Powered False 00:57:35.962356 run create_hlr_db(pid=21367): Terminated: ok {rc=0} 00:57:36.389192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21369): Launched 00:57:36.696128 run osmo-hlr_10.42.42.2(pid=21370): Launched 00:57:36.812187 run osmo-stp_10.42.42.5: Starting osmo-stp 00:57:37.361200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21372): Launched 00:57:37.668932 run osmo-stp_10.42.42.5(pid=21373): Launched 00:57:37.785470 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:57:38.310650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21375): Launched 00:57:38.430756 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:57:38.689780 run patchelf(pid=21376): Launched 00:57:38.862186 run osmo-stp_10.42.42.5(pid=21373): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21373)] 00:57:38.991910 run osmo-stp_10.42.42.5(pid=21373): stdout: | (launched: 2022-12-14_00:57:37.611869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:39.124033 run osmo-stp_10.42.42.5(pid=21373): stderr: | [0;m[38;5;43m20221214005737781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005737781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005737782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005737782 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005737783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005737783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005737783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:39.255751 run osmo-stp_10.42.42.5(pid=21373): stdout: | (launched: 2022-12-14_00:57:37.611869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:39.380369 run osmo-stp_10.42.42.5(pid=21373): stderr: | [0;m[38;5;43m20221214005737781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005737781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005737782 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005737782 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005737783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005737783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005737783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:39.528683 run patchelf(pid=21376): Terminating (SIGINT) 00:57:39.699890 run patchelf(pid=21376): Terminated: ok {rc=0} 00:57:39.823585 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21373): Process ended prematurely: osmo-stp_10.42.42.5(pid=21373) [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21373)] [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 00:57:39.833278 tst iperf3m4.py:8: Test FAILED (10.7 sec) 00:57:39.860680 run osmo-hlr_10.42.42.2(pid=21370): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21370)] 00:57:39.908210 run osmo-hlr_10.42.42.2(pid=21370): stdout: | (launched: 2022-12-14_00:57:36.639321) 00:57:39.958605 run osmo-hlr_10.42.42.2(pid=21370): stderr: | [0;m[1;31m20221214005736817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005736817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005736817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005736817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005736817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005736817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005736829 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005736838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005736839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005736839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:57:40.008261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21359): Terminating (SIGTERM) 00:57:40.047837 run iperf3-srv_10.42.42.10(pid=21360): Terminating (SIGTERM) 00:57:40.087411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21361): Terminating (SIGTERM) 00:57:40.127176 run iperf3-srv_10.42.42.10(pid=21362): Terminating (SIGTERM) 00:57:40.166867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21363): Terminating (SIGTERM) 00:57:40.206640 run iperf3-srv_10.42.42.10(pid=21364): Terminating (SIGTERM) 00:57:40.246137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21365): Terminating (SIGTERM) 00:57:40.285978 run iperf3-srv_10.42.42.10(pid=21366): Terminating (SIGTERM) 00:57:40.325933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21369): Terminating (SIGTERM) 00:57:40.365911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21372): Terminating (SIGTERM) 00:57:40.406155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21375): Terminating (SIGTERM) 00:57:40.446288 --- ParallelTerminationStrategy: PID 21359 died... 00:57:40.465679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21359): Terminated: ok {rc=0} 00:57:40.509755 --- ParallelTerminationStrategy: PID 21360 died... 00:57:40.528248 run iperf3-srv_10.42.42.10(pid=21360): Terminated {rc=256} 00:57:40.571975 --- ParallelTerminationStrategy: PID 21361 died... 00:57:40.590633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21361): Terminated: ok {rc=0} 00:57:40.634414 --- ParallelTerminationStrategy: PID 21362 died... 00:57:40.653044 run iperf3-srv_10.42.42.10(pid=21362): Terminated {rc=256} 00:57:40.696606 --- ParallelTerminationStrategy: PID 21363 died... 00:57:40.715280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21363): Terminated: ok {rc=0} 00:57:40.758874 --- ParallelTerminationStrategy: PID 21364 died... 00:57:40.777497 run iperf3-srv_10.42.42.10(pid=21364): Terminated {rc=256} 00:57:40.820749 --- ParallelTerminationStrategy: PID 21365 died... 00:57:40.839429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21365): Terminated: ok {rc=0} 00:57:40.883053 --- ParallelTerminationStrategy: PID 21366 died... 00:57:40.901773 run iperf3-srv_10.42.42.10(pid=21366): Terminated {rc=256} 00:57:40.945261 --- ParallelTerminationStrategy: PID 21369 died... 00:57:40.963879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21369): Terminated: ok {rc=0} 00:57:41.007702 --- ParallelTerminationStrategy: PID 21372 died... 00:57:41.026408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21372): Terminated: ok {rc=0} 00:57:41.070076 --- ParallelTerminationStrategy: PID 21375 died... 00:57:41.088711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21375): Terminated: ok {rc=0} 00:57:41.175097 bus /gobi_4: Setting Powered False 00:57:42.276180 bus /gobi_4: Setting Powered False 00:57:43.392940 bus /gobi_1: Setting Powered False 00:57:44.491891 bus /gobi_1: Setting Powered False 00:57:45.608886 bus /gobi_0: Setting Powered False 00:57:46.707243 bus /gobi_0: Setting Powered False 00:57:47.827657 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 00:57:48.931831 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:48.943965 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:57:49.004829 tst ping.py: using LAC 37432 00:57:49.132377 tst ping.py: using RAC 202 00:57:49.258354 tst ping.py: using CellId 37432 00:57:49.386240 tst ping.py: using BVCI 37433 00:57:49.503393 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:49.515040 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:49.526452 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:49.537873 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:49.549497 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:49.561205 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:49.572722 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:49.584237 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:49.703484 tst ping.py:19: start network... 00:57:49.920078 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:57:50.417442 run create_hlr_db(pid=21377): Launched 00:57:50.540021 bus /gobi_6: Setting Powered False 00:57:51.604176 run create_hlr_db(pid=21377): Terminated: ok {rc=0} 00:57:52.036842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21379): Launched 00:57:52.337731 run osmo-hlr_10.42.42.2(pid=21380): Launched 00:57:52.452155 run osmo-stp_10.42.42.5: Starting osmo-stp 00:57:52.971818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21382): Launched 00:57:53.273725 run osmo-stp_10.42.42.5(pid=21383): Launched 00:57:53.388665 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:57:53.907043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21385): Launched 00:57:54.021933 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:57:54.275322 run patchelf(pid=21386): Launched 00:57:54.442515 run osmo-stp_10.42.42.5(pid=21383): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21383)] 00:57:54.569108 run osmo-stp_10.42.42.5(pid=21383): stdout: | (launched: 2022-12-14_00:57:53.216608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:54.697937 run osmo-stp_10.42.42.5(pid=21383): stderr: | [0;m[38;5;43m20221214005753388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005753388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005753388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005753389 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005753389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005753389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005753389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:54.826697 run osmo-stp_10.42.42.5(pid=21383): stdout: | (launched: 2022-12-14_00:57:53.216608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:57:54.949365 run osmo-stp_10.42.42.5(pid=21383): stderr: | [0;m[38;5;43m20221214005753388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005753388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005753388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005753389 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005753389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005753389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005753389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:57:55.094458 run patchelf(pid=21386): Terminating (SIGINT) 00:57:55.262156 run patchelf(pid=21386): Terminated: ok {rc=0} 00:57:55.382896 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21383): Process ended prematurely: osmo-stp_10.42.42.5(pid=21383) [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21383)] [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 00:57:55.391778 tst ping.py:22: Test FAILED (6.5 sec) 00:57:55.418417 run osmo-hlr_10.42.42.2(pid=21380): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21380)] 00:57:55.465729 run osmo-hlr_10.42.42.2(pid=21380): stdout: | (launched: 2022-12-14_00:57:52.281863) 00:57:55.514482 run osmo-hlr_10.42.42.2(pid=21380): stderr: | [0;m[1;31m20221214005752457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005752457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005752457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005752457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005752457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005752457 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005752470 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005752478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005752478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005752478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:57:55.563688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21379): Terminating (SIGTERM) 00:57:55.603048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21382): Terminating (SIGTERM) 00:57:55.642270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21385): Terminating (SIGTERM) 00:57:55.681698 --- ParallelTerminationStrategy: PID 21379 died... 00:57:55.700455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21379): Terminated: ok {rc=0} 00:57:55.744004 --- ParallelTerminationStrategy: PID 21382 died... 00:57:55.762338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21382): Terminated: ok {rc=0} 00:57:55.805808 --- ParallelTerminationStrategy: PID 21385 died... 00:57:55.824299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21385): Terminated: ok {rc=0} 00:57:55.907499 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 00:57:56.994149 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:57.006382 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:57:57.065586 tst ping_idle_ping.py: using LAC 37433 00:57:57.186540 tst ping_idle_ping.py: using RAC 203 00:57:57.306204 tst ping_idle_ping.py: using CellId 37433 00:57:57.423872 tst ping_idle_ping.py: using BVCI 37434 00:57:57.534988 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:57.546002 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:57.556668 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:57.567369 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:57.577980 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:57.588534 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:57.599339 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:57:57.609997 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:57:57.730403 tst ping_idle_ping.py:24: start network... 00:57:57.947869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:57:58.455125 run create_hlr_db(pid=21387): Launched 00:57:58.579168 bus /gobi_6: Setting Powered False 00:57:59.642538 run create_hlr_db(pid=21387): Terminated: ok {rc=0} 00:58:00.074986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21389): Launched 00:58:00.377660 run osmo-hlr_10.42.42.2(pid=21390): Launched 00:58:00.493133 run osmo-stp_10.42.42.5: Starting osmo-stp 00:58:01.045512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21392): Launched 00:58:01.371429 run osmo-stp_10.42.42.5(pid=21393): Launched 00:58:01.578430 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:58:02.261075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21395): Launched 00:58:02.396174 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:58:02.651147 run patchelf(pid=21396): Launched 00:58:02.820664 run osmo-stp_10.42.42.5(pid=21393): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21393)] 00:58:02.947815 run osmo-stp_10.42.42.5(pid=21393): stdout: | (launched: 2022-12-14_00:58:01.313454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:03.077186 run osmo-stp_10.42.42.5(pid=21393): stderr: | [0;m[38;5;43m20221214005801679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005801679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005801679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005801680 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005801680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005801680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005801680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:03.206350 run osmo-stp_10.42.42.5(pid=21393): stdout: | (launched: 2022-12-14_00:58:01.313454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:03.329756 run osmo-stp_10.42.42.5(pid=21393): stderr: | [0;m[38;5;43m20221214005801679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005801679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005801679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005801680 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005801680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005801680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005801680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:03.475288 run patchelf(pid=21396): Terminating (SIGINT) 00:58:03.643253 run patchelf(pid=21396): Terminated: ok {rc=0} 00:58:03.764507 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21393): Process ended prematurely: osmo-stp_10.42.42.5(pid=21393) [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21393)] [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 00:58:03.773580 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 00:58:03.799966 run osmo-hlr_10.42.42.2(pid=21390): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21390)] 00:58:03.847207 run osmo-hlr_10.42.42.2(pid=21390): stdout: | (launched: 2022-12-14_00:58:00.321581) 00:58:03.896686 run osmo-hlr_10.42.42.2(pid=21390): stderr: | [0;m[1;31m20221214005800497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005800497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005800497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005800497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005800497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005800498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005800513 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005800523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005800523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005800523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:58:03.946176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21389): Terminating (SIGTERM) 00:58:03.985554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21392): Terminating (SIGTERM) 00:58:04.024802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21395): Terminating (SIGTERM) 00:58:04.064371 --- ParallelTerminationStrategy: PID 21389 died... 00:58:04.083332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21389): Terminated: ok {rc=0} 00:58:04.126751 --- ParallelTerminationStrategy: PID 21392 died... 00:58:04.144911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21392): Terminated: ok {rc=0} 00:58:04.188286 --- ParallelTerminationStrategy: PID 21395 died... 00:58:04.206705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21395): Terminated: ok {rc=0} 00:58:04.291785 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:58:05.580813 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:58:05.587460 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:58:05.607742 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 00:58:05.641784 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:58:05.694261 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:58:05.715094 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 00:58:05.749388 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:58:06.307417 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2397 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 00:58:06.312478 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:58:06.323643 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:58:06.380173 tst switch_tch_pdch.py: using LAC 37434 00:58:06.499231 tst switch_tch_pdch.py: using RAC 204 00:58:06.626776 tst switch_tch_pdch.py: using CellId 37434 00:58:06.752602 tst switch_tch_pdch.py: using BVCI 37435 00:58:06.871630 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:58:06.883506 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:58:06.895131 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:58:06.906804 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:58:06.918552 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:58:06.930427 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:58:06.942319 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:58:06.954110 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:58:07.071107 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:58:07.189544 tst switch_tch_pdch.py:51: start network... 00:58:07.406909 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:58:07.906233 run create_hlr_db(pid=21401): Launched 00:58:08.029998 bus /gobi_6: Setting Powered False 00:58:09.093189 run create_hlr_db(pid=21401): Terminated: ok {rc=0} 00:58:09.524375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21403): Launched 00:58:09.825832 run osmo-hlr_10.42.42.2(pid=21404): Launched 00:58:09.939778 run osmo-stp_10.42.42.5: Starting osmo-stp 00:58:10.457093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21406): Launched 00:58:10.757434 run osmo-stp_10.42.42.5(pid=21407): Launched 00:58:10.871984 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:58:11.393451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21409): Launched 00:58:11.509242 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:58:11.763913 run patchelf(pid=21410): Launched 00:58:11.930581 run osmo-stp_10.42.42.5(pid=21407): ERR: Terminated: ERROR {rc=1} [trial-2397↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21407)] 00:58:12.057114 run osmo-stp_10.42.42.5(pid=21407): stdout: | (launched: 2022-12-14_00:58:10.701640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:12.185652 run osmo-stp_10.42.42.5(pid=21407): stderr: | [0;m[38;5;43m20221214005810871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005810871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005810871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005810871 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005810872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005810872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005810872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:12.314149 run osmo-stp_10.42.42.5(pid=21407): stdout: | (launched: 2022-12-14_00:58:10.701640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:12.437117 run osmo-stp_10.42.42.5(pid=21407): stderr: | [0;m[38;5;43m20221214005810871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005810871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005810871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005810871 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005810872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005810872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005810872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:12.582157 run patchelf(pid=21410): Terminating (SIGINT) 00:58:12.749564 run patchelf(pid=21410): Terminated: ok {rc=0} 00:58:12.870090 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21407): Process ended prematurely: osmo-stp_10.42.42.5(pid=21407) [trial-2397↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21407)] [trial-2397↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 00:58:12.878817 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 00:58:12.905341 run osmo-hlr_10.42.42.2(pid=21404): ERR: Terminated: ERROR {rc=237} [trial-2397↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21404)] 00:58:12.952556 run osmo-hlr_10.42.42.2(pid=21404): stdout: | (launched: 2022-12-14_00:58:09.770039) 00:58:13.001356 run osmo-hlr_10.42.42.2(pid=21404): stderr: | [0;m[1;31m20221214005809945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005809945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005809946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005809946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005809946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005809946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005809958 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005809966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005809967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005809967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:58:13.050616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21403): Terminating (SIGTERM) 00:58:13.090085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21406): Terminating (SIGTERM) 00:58:13.129592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21409): Terminating (SIGTERM) 00:58:13.169662 --- ParallelTerminationStrategy: PID 21403 died... 00:58:13.188779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21403): Terminated: ok {rc=0} 00:58:13.231947 --- ParallelTerminationStrategy: PID 21406 died... 00:58:13.250220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21406): Terminated: ok {rc=0} 00:58:13.293421 --- ParallelTerminationStrategy: PID 21409 died... 00:58:13.311728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21409): Terminated: ok {rc=0} 00:58:13.396492 bus /gobi_0: Setting Powered False 00:58:14.495871 bus /gobi_0: Setting Powered False 00:58:15.608312 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 00:58:16.882078 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:58:16.890715 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 00:58:16.916677 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 00:58:16.959892 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 00:58:17.021813 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 00:58:17.069065 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 00:58:17.118172 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 00:58:17.630174 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2397 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 00:58:17.635608 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:58:17.646618 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 00:58:17.704275 tst switch_tch_pdch.py: using LAC 37435 00:58:17.823832 tst switch_tch_pdch.py: using RAC 205 00:58:17.941424 tst switch_tch_pdch.py: using CellId 37435 00:58:18.059456 tst switch_tch_pdch.py: using BVCI 37436 00:58:18.169276 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:58:18.180131 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:58:18.190775 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:58:18.201433 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:58:18.211901 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:58:18.222488 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:58:18.233876 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:58:18.244438 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:58:18.364530 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:58:18.479620 tst switch_tch_pdch.py:51: start network... 00:58:18.680580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:58:19.121164 run create_hlr_db(pid=21414): Launched 00:58:19.244012 bus /gobi_6: Setting Powered False 00:58:20.304303 run create_hlr_db(pid=21414): Terminated: ok {rc=0} 00:58:20.718310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21416): Launched 00:58:21.042636 run osmo-hlr_10.42.42.2(pid=21417): Launched 00:58:21.165495 run osmo-stp_10.42.42.5: Starting osmo-stp 00:58:21.692215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21419): Launched 00:58:22.015790 run osmo-stp_10.42.42.5(pid=21420): Launched 00:58:22.140914 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:58:22.669705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21422): Launched 00:58:22.795392 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:58:23.068236 run patchelf(pid=21423): Launched 00:58:23.246905 run osmo-stp_10.42.42.5(pid=21420): ERR: Terminated: ERROR {rc=1} [trial-2397↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21420)] 00:58:23.382979 run osmo-stp_10.42.42.5(pid=21420): stdout: | (launched: 2022-12-14_00:58:21.956436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:23.521636 run osmo-stp_10.42.42.5(pid=21420): stderr: | [0;m[38;5;43m20221214005822149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005822149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005822150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005822150 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005822151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005822151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005822151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:23.659376 run osmo-stp_10.42.42.5(pid=21420): stdout: | (launched: 2022-12-14_00:58:21.956436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:23.790839 run osmo-stp_10.42.42.5(pid=21420): stderr: | [0;m[38;5;43m20221214005822149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005822149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005822150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005822150 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005822151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005822151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005822151 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:23.946155 run patchelf(pid=21423): Terminating (SIGINT) 00:58:24.125509 run patchelf(pid=21423): Terminated: ok {rc=0} 00:58:24.254797 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21420): Process ended prematurely: osmo-stp_10.42.42.5(pid=21420) [trial-2397↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21420)] [trial-2397↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 00:58:24.264451 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 00:58:24.292493 run osmo-hlr_10.42.42.2(pid=21417): ERR: Terminated: ERROR {rc=237} [trial-2397↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21417)] 00:58:24.343178 run osmo-hlr_10.42.42.2(pid=21417): stdout: | (launched: 2022-12-14_00:58:20.982803) 00:58:24.395069 run osmo-hlr_10.42.42.2(pid=21417): stderr: | [0;m[1;31m20221214005821181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005821181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005821181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005821181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005821181 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005821182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005821193 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005821201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005821201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005821201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:58:24.447988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21416): Terminating (SIGTERM) 00:58:24.490438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21419): Terminating (SIGTERM) 00:58:24.532881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21422): Terminating (SIGTERM) 00:58:24.575069 --- ParallelTerminationStrategy: PID 21416 died... 00:58:24.595203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21416): Terminated: ok {rc=0} 00:58:24.641571 --- ParallelTerminationStrategy: PID 21419 died... 00:58:24.661485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21419): Terminated: ok {rc=0} 00:58:24.708149 --- ParallelTerminationStrategy: PID 21422 died... 00:58:24.728440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21422): Terminated: ok {rc=0} 00:58:24.817984 bus /gobi_0: Setting Powered False 00:58:25.916922 bus /gobi_0: Setting Powered False 00:58:27.035455 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 nitb_sms:trx-b200 --------------------------------------------------------------------- 00:58:28.271222 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:58:28.275200 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 00:58:28.307993 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 00:58:28.315172 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 00:58:28.365630 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 00:58:28.399080 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 00:58:28.406360 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 00:58:28.947905 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 00:58:28.953914 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 00:58:28.965164 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 00:58:29.015023 tst mo_mt_sms.py: using LAC 37436 00:58:29.132374 tst mo_mt_sms.py: using RAC 206 00:58:29.249345 tst mo_mt_sms.py: using CellId 37436 00:58:29.365864 tst mo_mt_sms.py: using BVCI 37437 00:58:29.475479 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 00:58:29.593081 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 00:58:29.708087 tst mo_mt_sms.py:9: start nitb and bts... 00:58:29.927477 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:58:30.588456 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21427): Launched 00:58:30.929822 run osmo-nitb_10.42.42.2(pid=21428): Launched 00:58:31.121917 run osmo-nitb_10.42.42.2(pid=21428): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21428)] 00:58:31.269367 run osmo-nitb_10.42.42.2(pid=21428): stdout: | (launched: 2022-12-14_00:58:30.860427) 00:58:31.418298 run osmo-nitb_10.42.42.2(pid=21428): stderr: | (launched: 2022-12-14_00:58:30.914514) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:58:31.567618 run osmo-nitb_10.42.42.2(pid=21428): stdout: | (launched: 2022-12-14_00:58:30.860427) 00:58:31.718739 run osmo-nitb_10.42.42.2(pid=21428): stderr: | (launched: 2022-12-14_00:58:30.914514) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8b7301f268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21428): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21428) [trial-2397↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21428)] 00:58:32.063280 tst osmo-nitb_10.42.42.2(pid=21428): stdout: | (launched: 2022-12-14_00:58:30.860427) 00:58:32.195331 tst osmo-nitb_10.42.42.2(pid=21428): stderr: | (launched: 2022-12-14_00:58:30.914514) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:58:32.342834 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=21428): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21428) [trial-2397↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21428)] [trial-2397↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 00:58:32.352124 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 00:58:32.359534 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21427): Terminating (SIGTERM) 00:58:32.569762 --- ParallelTerminationStrategy: PID 21427 died... 00:58:32.590917 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21427): Terminated: ok {rc=0} 00:58:32.678486 bus /sierra_3: Setting Powered False 00:58:33.779358 bus /sierra_3: Setting Powered False 00:58:34.894517 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 sms:trx-b200 --------------------------------------------------------------------- 00:58:36.093532 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:58:36.098719 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 00:58:36.131933 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 00:58:36.158816 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 00:58:36.211596 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 00:58:36.244347 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 00:58:36.270513 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 00:58:36.815402 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 00:58:36.820575 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:36.831293 tst sms:trx-b200: Using 1 x bts (candidates: 1) 00:58:36.878786 tst mo_mt_sms.py: using LAC 37437 00:58:36.998112 tst mo_mt_sms.py: using RAC 207 00:58:37.115311 tst mo_mt_sms.py: using CellId 37437 00:58:37.234626 tst mo_mt_sms.py: using BVCI 37438 00:58:37.342975 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:37.353659 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:37.364298 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:37.374716 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:37.385913 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:37.396207 tst sms:trx-b200: Using 1 x modem (candidates: 2) 00:58:37.517766 tst sms:trx-b200: Using 1 x modem (candidates: 2) 00:58:37.635676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:58:38.106061 run create_hlr_db(pid=21432): Launched 00:58:38.231508 bus /sierra_2: Setting Powered False 00:58:39.291216 run create_hlr_db(pid=21432): Terminated: ok {rc=0} 00:58:39.714552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21434): Launched 00:58:40.017123 run osmo-hlr_10.42.42.2(pid=21435): Launched 00:58:40.132016 run osmo-stp_10.42.42.5: Starting osmo-stp 00:58:40.649139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21437): Launched 00:58:40.950029 run osmo-stp_10.42.42.5(pid=21438): Launched 00:58:41.064200 run osmo-msc_10.42.42.6: Starting osmo-msc 00:58:41.607220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21440): Launched 00:58:41.910033 run osmo-msc_10.42.42.6(pid=21441): Launched 00:58:42.077431 run osmo-stp_10.42.42.5(pid=21438): ERR: Terminated: ERROR {rc=1} [trial-2397↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21438)] 00:58:42.203050 run osmo-stp_10.42.42.5(pid=21438): stdout: | (launched: 2022-12-14_00:58:40.893801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:42.329585 run osmo-stp_10.42.42.5(pid=21438): stderr: | [0;m[38;5;43m20221214005841063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005841063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005841063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005841063 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005841064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005841064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005841064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:42.454585 run osmo-stp_10.42.42.5(pid=21438): stdout: | (launched: 2022-12-14_00:58:40.893801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:42.574156 run osmo-stp_10.42.42.5(pid=21438): stderr: | [0;m[38;5;43m20221214005841063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005841063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005841063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005841063 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005841064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005841064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005841064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:42.717291 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=21438): Process ended prematurely: osmo-stp_10.42.42.5(pid=21438) [trial-2397↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21438)] [trial-2397↪sms:trx-b200↪mo_mt_sms.py:16] 00:58:42.725810 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 00:58:42.751738 run osmo-hlr_10.42.42.2(pid=21435): ERR: Terminated: ERROR {rc=237} [trial-2397↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21435)] 00:58:42.799672 run osmo-hlr_10.42.42.2(pid=21435): stdout: | (launched: 2022-12-14_00:58:39.961030) 00:58:42.849303 run osmo-hlr_10.42.42.2(pid=21435): stderr: | [0;m[1;31m20221214005840135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005840135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005840135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005840135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005840135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005840135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005840148 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005840158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005840158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005840158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:58:42.918359 run osmo-msc_10.42.42.6(pid=21441): ERR: Terminated: ERROR {rc=2} [trial-2397↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21441)] 00:58:42.965968 run osmo-msc_10.42.42.6(pid=21441): stdout: | (launched: 2022-12-14_00:58:41.854021) 00:58:43.014949 run osmo-msc_10.42.42.6(pid=21441): stderr: | [0;m[38;5;43m20221214005842127 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005842127 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f65a5802c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005842128 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005842128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005842128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005842128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005842130 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005842130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005842130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005842130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:58:43.064129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21434): Terminating (SIGTERM) 00:58:43.104133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21437): Terminating (SIGTERM) 00:58:43.144508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21440): Terminating (SIGTERM) 00:58:43.184756 --- ParallelTerminationStrategy: PID 21434 died... 00:58:43.204098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21434): Terminated: ok {rc=0} 00:58:43.248389 --- ParallelTerminationStrategy: PID 21437 died... 00:58:43.267269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21437): Terminated: ok {rc=0} 00:58:43.311257 --- ParallelTerminationStrategy: PID 21440 died... 00:58:43.330088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21440): Terminated: ok {rc=0} 00:58:43.416342 bus /sierra_3: Setting Powered False 00:58:44.517831 bus /sierra_3: Setting Powered False 00:58:45.634271 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 nitb_ussd:trx-b200 --------------------------------------------------------------------- 00:58:46.888303 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:58:46.896887 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 00:58:46.939502 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 00:58:46.947236 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 00:58:46.985070 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 00:58:47.033462 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 00:58:47.043842 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 00:58:47.546597 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2397 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 00:58:47.552800 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 00:58:47.564633 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 00:58:47.616542 tst assert_extension.py: using LAC 37438 00:58:47.744164 tst assert_extension.py: using RAC 208 00:58:47.873723 tst assert_extension.py: using CellId 37438 00:58:47.992191 tst assert_extension.py: using BVCI 37439 00:58:48.101455 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 00:58:48.219726 tst assert_extension.py:10: start nitb and bts... 00:58:48.438119 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:58:49.098134 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21446): Launched 00:58:49.422179 run osmo-nitb_10.42.42.2(pid=21447): Launched 00:58:49.602812 run osmo-nitb_10.42.42.2(pid=21447): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21447)] 00:58:49.747680 run osmo-nitb_10.42.42.2(pid=21447): stdout: | (launched: 2022-12-14_00:58:49.362724) 00:58:49.894013 run osmo-nitb_10.42.42.2(pid=21447): stderr: | (launched: 2022-12-14_00:58:49.410505) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:58:50.040427 run osmo-nitb_10.42.42.2(pid=21447): stdout: | (launched: 2022-12-14_00:58:49.362724) 00:58:50.180279 run osmo-nitb_10.42.42.2(pid=21447): stderr: | (launched: 2022-12-14_00:58:49.410505) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8b7301f268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21447): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21447) [trial-2397↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21447)] 00:58:50.545784 tst osmo-nitb_10.42.42.2(pid=21447): stdout: | (launched: 2022-12-14_00:58:49.362724) 00:58:50.676162 tst osmo-nitb_10.42.42.2(pid=21447): stderr: | (launched: 2022-12-14_00:58:49.410505) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:58:50.830624 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=21447): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21447) [trial-2397↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21447)] [trial-2397↪nitb_ussd:trx-b200↪assert_extension.py:12] 00:58:50.839951 tst assert_extension.py:12: Test FAILED (3.3 sec) 00:58:50.847334 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21446): Terminating (SIGTERM) 00:58:51.059926 --- ParallelTerminationStrategy: PID 21446 died... 00:58:51.081788 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21446): Terminated: ok {rc=0} 00:58:51.172360 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 ussd:trx-b200 --------------------------------------------------------------------- 00:58:52.350266 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:58:52.354752 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 00:58:52.388003 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 00:58:52.418293 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 00:58:52.454798 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 00:58:52.489224 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 00:58:52.517271 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 00:58:53.044848 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2397 ussd:trx-b200 assert_extension.py ---------------------------------------------- 00:58:53.050314 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:53.061548 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 00:58:53.111392 tst assert_extension.py: using LAC 37439 00:58:53.230982 tst assert_extension.py: using RAC 209 00:58:53.353483 tst assert_extension.py: using CellId 37439 00:58:53.481358 tst assert_extension.py: using BVCI 37440 00:58:53.600885 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:53.612146 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:53.623326 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:53.634712 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:53.646127 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 00:58:53.657358 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 00:58:53.774848 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:58:54.241782 run create_hlr_db(pid=21451): Launched 00:58:54.365645 bus /sierra_2: Setting Powered False 00:58:55.429281 run create_hlr_db(pid=21451): Terminated: ok {rc=0} 00:58:55.881044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21453): Launched 00:58:56.205609 run osmo-hlr_10.42.42.2(pid=21454): Launched 00:58:56.331136 run osmo-stp_10.42.42.5: Starting osmo-stp 00:58:56.891517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21456): Launched 00:58:57.218564 run osmo-stp_10.42.42.5(pid=21457): Launched 00:58:57.342014 run osmo-msc_10.42.42.6: Starting osmo-msc 00:58:57.924680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21459): Launched 00:58:58.248752 run osmo-msc_10.42.42.6(pid=21460): Launched 00:58:58.429281 run osmo-stp_10.42.42.5(pid=21457): ERR: Terminated: ERROR {rc=1} [trial-2397↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21457)] 00:58:58.565210 run osmo-stp_10.42.42.5(pid=21457): stdout: | (launched: 2022-12-14_00:58:57.157882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:58.701266 run osmo-stp_10.42.42.5(pid=21457): stderr: | [0;m[38;5;43m20221214005857350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005857350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005857351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005857351 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005857352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005857352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005857352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:58.836647 run osmo-stp_10.42.42.5(pid=21457): stdout: | (launched: 2022-12-14_00:58:57.157882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:58:58.964901 run osmo-stp_10.42.42.5(pid=21457): stderr: | [0;m[38;5;43m20221214005857350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005857350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005857351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005857351 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005857352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005857352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005857352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:58:59.118679 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=21457): Process ended prematurely: osmo-stp_10.42.42.5(pid=21457) [trial-2397↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21457)] [trial-2397↪ussd:trx-b200↪assert_extension.py:17] 00:58:59.127606 tst assert_extension.py:17: Test FAILED (6.1 sec) 00:58:59.155297 run osmo-hlr_10.42.42.2(pid=21454): ERR: Terminated: ERROR {rc=237} [trial-2397↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21454)] 00:58:59.206361 run osmo-hlr_10.42.42.2(pid=21454): stdout: | (launched: 2022-12-14_00:58:56.146043) 00:58:59.259211 run osmo-hlr_10.42.42.2(pid=21454): stderr: | [0;m[1;31m20221214005856344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005856344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005856344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005856344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005856344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005856344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005856360 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005856369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005856370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005856370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:58:59.332248 run osmo-msc_10.42.42.6(pid=21460): ERR: Terminated: ERROR {rc=2} [trial-2397↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21460)] 00:58:59.382541 run osmo-msc_10.42.42.6(pid=21460): stdout: | (launched: 2022-12-14_00:58:58.189218) 00:58:59.435067 run osmo-msc_10.42.42.6(pid=21460): stderr: | [0;m[38;5;43m20221214005858511 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005858511 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fba89699c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005858511 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005858511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005858512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005858512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005858514 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005858514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005858514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005858514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:58:59.488267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21453): Terminating (SIGTERM) 00:58:59.530556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21456): Terminating (SIGTERM) 00:58:59.573014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21459): Terminating (SIGTERM) 00:58:59.615715 --- ParallelTerminationStrategy: PID 21453 died... 00:58:59.636606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21453): Terminated: ok {rc=0} 00:58:59.684078 --- ParallelTerminationStrategy: PID 21456 died... 00:58:59.704009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21456): Terminated: ok {rc=0} 00:58:59.750787 --- ParallelTerminationStrategy: PID 21459 died... 00:58:59.771186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21459): Terminated: ok {rc=0} 00:58:59.859669 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 00:59:01.080554 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:59:01.087887 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 00:59:01.123393 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 00:59:01.152128 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 00:59:01.204452 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 00:59:01.238128 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 00:59:01.265831 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 00:59:01.849284 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 00:59:01.917120 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:01.931299 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:59:02.011319 tst mo_mt_call.py: using LAC 37440 00:59:02.144766 tst mo_mt_call.py: using RAC 210 00:59:02.282459 tst mo_mt_call.py: using CellId 37440 00:59:02.412710 tst mo_mt_call.py: using BVCI 37441 00:59:02.533899 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:02.545492 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:02.556752 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:02.568156 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:02.579879 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:02.591597 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:59:02.709042 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:59:02.825979 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:59:03.301497 run create_hlr_db(pid=21465): Launched 00:59:03.427908 bus /sierra_2: Setting Powered False 00:59:04.489533 run create_hlr_db(pid=21465): Terminated: ok {rc=0} 00:59:04.938039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21467): Launched 00:59:05.266951 run osmo-hlr_10.42.42.2(pid=21468): Launched 00:59:05.393946 run osmo-stp_10.42.42.5: Starting osmo-stp 00:59:05.958733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21470): Launched 00:59:06.289494 run osmo-stp_10.42.42.5(pid=21471): Launched 00:59:06.417286 run osmo-msc_10.42.42.6: Starting osmo-msc 00:59:07.015254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21473): Launched 00:59:07.347298 run osmo-msc_10.42.42.6(pid=21474): Launched 00:59:07.532658 run osmo-stp_10.42.42.5(pid=21471): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21471)] 00:59:07.670718 run osmo-stp_10.42.42.5(pid=21471): stdout: | (launched: 2022-12-14_00:59:06.229100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:07.810566 run osmo-stp_10.42.42.5(pid=21471): stderr: | [0;m[38;5;43m20221214005906422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005906423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005906423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005906423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005906424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005906424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005906424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:07.948368 run osmo-stp_10.42.42.5(pid=21471): stdout: | (launched: 2022-12-14_00:59:06.229100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:08.079112 run osmo-stp_10.42.42.5(pid=21471): stderr: | [0;m[38;5;43m20221214005906422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005906423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005906423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005906423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005906424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005906424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005906424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:08.235058 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21471): Process ended prematurely: osmo-stp_10.42.42.5(pid=21471) [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21471)] [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 00:59:08.244788 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 00:59:08.272579 run osmo-hlr_10.42.42.2(pid=21468): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21468)] 00:59:08.323524 run osmo-hlr_10.42.42.2(pid=21468): stdout: | (launched: 2022-12-14_00:59:05.206716) 00:59:08.376059 run osmo-hlr_10.42.42.2(pid=21468): stderr: | [0;m[1;31m20221214005905406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005905406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005905406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005905406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005905406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005905406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005905418 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005905426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005905426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005905426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:59:08.449045 run osmo-msc_10.42.42.6(pid=21474): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21474)] 00:59:08.499231 run osmo-msc_10.42.42.6(pid=21474): stdout: | (launched: 2022-12-14_00:59:07.286405) 00:59:08.551401 run osmo-msc_10.42.42.6(pid=21474): stderr: | [0;m[38;5;43m20221214005907610 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005907610 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc1f39f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005907610 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005907610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005907610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005907610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005907612 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005907612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005907613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005907613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:59:08.603700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21467): Terminating (SIGTERM) 00:59:08.645735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21470): Terminating (SIGTERM) 00:59:08.687894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21473): Terminating (SIGTERM) 00:59:08.730427 --- ParallelTerminationStrategy: PID 21467 died... 00:59:08.750695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21467): Terminated: ok {rc=0} 00:59:08.797098 --- ParallelTerminationStrategy: PID 21470 died... 00:59:08.816666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21470): Terminated: ok {rc=0} 00:59:08.863352 --- ParallelTerminationStrategy: PID 21473 died... 00:59:08.883237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21473): Terminated: ok {rc=0} 00:59:08.971341 bus /sierra_3: Setting Powered False 00:59:10.071073 bus /sierra_3: Setting Powered False 00:59:11.189427 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 00:59:12.334277 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:12.346219 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:59:12.415604 tst mo_mt_call_osmux.py: using LAC 37441 00:59:12.536123 tst mo_mt_call_osmux.py: using RAC 211 00:59:12.657997 tst mo_mt_call_osmux.py: using CellId 37441 00:59:12.780833 tst mo_mt_call_osmux.py: using BVCI 37442 00:59:12.893515 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:12.904451 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:12.915286 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:12.926145 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:12.937040 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:59:12.947847 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:59:13.063324 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:59:13.184544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:59:13.693754 run create_hlr_db(pid=21476): Launched 00:59:13.819644 bus /sierra_2: Setting Powered False 00:59:14.883879 run create_hlr_db(pid=21476): Terminated: ok {rc=0} 00:59:15.341702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21478): Launched 00:59:15.670943 run osmo-hlr_10.42.42.2(pid=21479): Launched 00:59:15.797663 run osmo-stp_10.42.42.5: Starting osmo-stp 00:59:16.464360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21481): Launched 00:59:16.794064 run osmo-stp_10.42.42.5(pid=21482): Launched 00:59:16.992163 run osmo-msc_10.42.42.6: Starting osmo-msc 00:59:17.785436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21484): Launched 00:59:18.114790 run osmo-msc_10.42.42.6(pid=21485): Launched 00:59:18.297949 run osmo-stp_10.42.42.5(pid=21482): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21482)] 00:59:18.435138 run osmo-stp_10.42.42.5(pid=21482): stdout: | (launched: 2022-12-14_00:59:16.734330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:18.573957 run osmo-stp_10.42.42.5(pid=21482): stderr: | [0;m[38;5;43m20221214005917034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005917034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005917034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005917035 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005917035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005917035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005917035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:18.710371 run osmo-stp_10.42.42.5(pid=21482): stdout: | (launched: 2022-12-14_00:59:16.734330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:18.840563 run osmo-stp_10.42.42.5(pid=21482): stderr: | [0;m[38;5;43m20221214005917034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005917034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005917034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005917035 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005917035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005917035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005917035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:18.996244 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21482): Process ended prematurely: osmo-stp_10.42.42.5(pid=21482) [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21482)] [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 00:59:19.006167 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 00:59:19.033979 run osmo-hlr_10.42.42.2(pid=21479): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21479)] 00:59:19.084805 run osmo-hlr_10.42.42.2(pid=21479): stdout: | (launched: 2022-12-14_00:59:15.610862) 00:59:19.137111 run osmo-hlr_10.42.42.2(pid=21479): stderr: | [0;m[1;31m20221214005915809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005915810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005915810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005915810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005915810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005915810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005915823 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005915848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005915858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005915858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:59:19.209433 run osmo-msc_10.42.42.6(pid=21485): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21485)] 00:59:19.259883 run osmo-msc_10.42.42.6(pid=21485): stdout: | (launched: 2022-12-14_00:59:18.054080) 00:59:19.311942 run osmo-msc_10.42.42.6(pid=21485): stderr: | [0;m[38;5;43m20221214005918374 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005918375 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2b8cc03c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005918375 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005918375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005918375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005918375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005918377 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005918377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005918378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005918378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:59:19.364214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21478): Terminating (SIGTERM) 00:59:19.406369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21481): Terminating (SIGTERM) 00:59:19.448756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21484): Terminating (SIGTERM) 00:59:19.491445 --- ParallelTerminationStrategy: PID 21478 died... 00:59:19.511941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21478): Terminated: ok {rc=0} 00:59:19.558749 --- ParallelTerminationStrategy: PID 21481 died... 00:59:19.578560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21481): Terminated: ok {rc=0} 00:59:19.624753 --- ParallelTerminationStrategy: PID 21484 died... 00:59:19.644600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21484): Terminated: ok {rc=0} 00:59:19.732539 bus /sierra_3: Setting Powered False 00:59:20.831032 bus /sierra_3: Setting Powered False 00:59:21.946607 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 00:59:23.202440 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:59:23.209670 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 00:59:23.243496 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 00:59:23.271521 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 00:59:23.324739 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 00:59:23.358955 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 00:59:23.386880 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 00:59:23.937575 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 00:59:23.990368 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:24.001909 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:59:24.073789 tst mo_mt_call.py: using LAC 37442 00:59:24.203568 tst mo_mt_call.py: using RAC 212 00:59:24.331074 tst mo_mt_call.py: using CellId 37442 00:59:24.460198 tst mo_mt_call.py: using BVCI 37443 00:59:24.578806 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:24.590823 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:24.602411 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:24.613795 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:24.625599 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:24.637285 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:59:24.754474 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:59:24.876261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:59:25.386725 run create_hlr_db(pid=21490): Launched 00:59:25.512372 bus /sierra_2: Setting Powered False 00:59:26.577131 run create_hlr_db(pid=21490): Terminated: ok {rc=0} 00:59:27.034869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21492): Launched 00:59:27.363269 run osmo-hlr_10.42.42.2(pid=21493): Launched 00:59:27.490882 run osmo-stp_10.42.42.5: Starting osmo-stp 00:59:28.058991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21495): Launched 00:59:28.389631 run osmo-stp_10.42.42.5(pid=21496): Launched 00:59:28.518133 run osmo-msc_10.42.42.6: Starting osmo-msc 00:59:29.113071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21498): Launched 00:59:29.442398 run osmo-msc_10.42.42.6(pid=21499): Launched 00:59:29.627522 run osmo-stp_10.42.42.5(pid=21496): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21496)] 00:59:29.766179 run osmo-stp_10.42.42.5(pid=21496): stdout: | (launched: 2022-12-14_00:59:28.329291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:29.905317 run osmo-stp_10.42.42.5(pid=21496): stderr: | [0;m[38;5;43m20221214005928522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005928522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005928523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005928523 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005928523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005928524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005928524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:30.042256 run osmo-stp_10.42.42.5(pid=21496): stdout: | (launched: 2022-12-14_00:59:28.329291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:30.172759 run osmo-stp_10.42.42.5(pid=21496): stderr: | [0;m[38;5;43m20221214005928522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005928522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005928523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005928523 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005928523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005928524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005928524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:30.329029 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21496): Process ended prematurely: osmo-stp_10.42.42.5(pid=21496) [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21496)] [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 00:59:30.338796 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 00:59:30.366726 run osmo-hlr_10.42.42.2(pid=21493): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21493)] 00:59:30.418429 run osmo-hlr_10.42.42.2(pid=21493): stdout: | (launched: 2022-12-14_00:59:27.303016) 00:59:30.470649 run osmo-hlr_10.42.42.2(pid=21493): stderr: | [0;m[1;31m20221214005927502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005927502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005927502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005927502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005927502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005927502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005927515 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005927524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005927524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005927524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:59:30.543405 run osmo-msc_10.42.42.6(pid=21499): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21499)] 00:59:30.593410 run osmo-msc_10.42.42.6(pid=21499): stdout: | (launched: 2022-12-14_00:59:29.382024) 00:59:30.645280 run osmo-msc_10.42.42.6(pid=21499): stderr: | [0;m[38;5;43m20221214005929704 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005929704 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff43ef7ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005929704 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005929704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005929705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005929705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005929706 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005929707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005929707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005929707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:59:30.697592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21492): Terminating (SIGTERM) 00:59:30.739808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21495): Terminating (SIGTERM) 00:59:30.782538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21498): Terminating (SIGTERM) 00:59:30.825043 --- ParallelTerminationStrategy: PID 21492 died... 00:59:30.850580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21492): Terminated: ok {rc=0} 00:59:30.906092 --- ParallelTerminationStrategy: PID 21495 died... 00:59:30.926866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21495): Terminated: ok {rc=0} 00:59:30.990898 --- ParallelTerminationStrategy: PID 21498 died... 00:59:31.011499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21498): Terminated: ok {rc=0} 00:59:31.103952 bus /sierra_3: Setting Powered False 00:59:32.199100 bus /sierra_3: Setting Powered False 00:59:33.317650 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 00:59:34.465726 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:34.477785 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:59:34.548358 tst mo_mt_call_osmux.py: using LAC 37443 00:59:34.667930 tst mo_mt_call_osmux.py: using RAC 213 00:59:34.788747 tst mo_mt_call_osmux.py: using CellId 37443 00:59:34.908663 tst mo_mt_call_osmux.py: using BVCI 37444 00:59:35.018849 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:35.030067 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:35.041118 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:35.052090 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:35.063088 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:59:35.074050 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:59:35.187763 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:59:35.304562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:59:35.779571 run create_hlr_db(pid=21501): Launched 00:59:35.905328 bus /sierra_2: Setting Powered False 00:59:36.966078 run create_hlr_db(pid=21501): Terminated: ok {rc=0} 00:59:37.394086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21503): Launched 00:59:37.702334 run osmo-hlr_10.42.42.2(pid=21504): Launched 00:59:37.819940 run osmo-stp_10.42.42.5: Starting osmo-stp 00:59:38.346272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21506): Launched 00:59:38.654448 run osmo-stp_10.42.42.5(pid=21507): Launched 00:59:38.771110 run osmo-msc_10.42.42.6: Starting osmo-msc 00:59:39.331383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21509): Launched 00:59:39.639002 run osmo-msc_10.42.42.6(pid=21510): Launched 00:59:39.809808 run osmo-stp_10.42.42.5(pid=21507): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21507)] 00:59:39.938880 run osmo-stp_10.42.42.5(pid=21507): stdout: | (launched: 2022-12-14_00:59:38.597594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:40.069992 run osmo-stp_10.42.42.5(pid=21507): stderr: | [0;m[38;5;43m20221214005938768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005938768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005938769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005938769 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005938770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005938770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005938770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:40.198430 run osmo-stp_10.42.42.5(pid=21507): stdout: | (launched: 2022-12-14_00:59:38.597594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:40.320018 run osmo-stp_10.42.42.5(pid=21507): stderr: | [0;m[38;5;43m20221214005938768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005938768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005938769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005938769 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005938770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005938770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005938770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:40.465884 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21507): Process ended prematurely: osmo-stp_10.42.42.5(pid=21507) [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21507)] [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 00:59:40.474927 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 00:59:40.501359 run osmo-hlr_10.42.42.2(pid=21504): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21504)] 00:59:40.549067 run osmo-hlr_10.42.42.2(pid=21504): stdout: | (launched: 2022-12-14_00:59:37.644499) 00:59:40.598285 run osmo-hlr_10.42.42.2(pid=21504): stderr: | [0;m[1;31m20221214005937822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005937822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005937822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005937822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005937822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005937822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005937834 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005937843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005937843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005937843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:59:40.667556 run osmo-msc_10.42.42.6(pid=21510): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21510)] 00:59:40.715076 run osmo-msc_10.42.42.6(pid=21510): stdout: | (launched: 2022-12-14_00:59:39.581431) 00:59:40.764113 run osmo-msc_10.42.42.6(pid=21510): stderr: | [0;m[38;5;43m20221214005939854 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005939854 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb250c8ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005939854 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005939854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005939854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005939855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005939856 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005939857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005939857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005939857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:59:40.813670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21503): Terminating (SIGTERM) 00:59:40.853061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21506): Terminating (SIGTERM) 00:59:40.892370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21509): Terminating (SIGTERM) 00:59:40.932277 --- ParallelTerminationStrategy: PID 21503 died... 00:59:40.951385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21503): Terminated: ok {rc=0} 00:59:40.995124 --- ParallelTerminationStrategy: PID 21506 died... 00:59:41.013726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21506): Terminated: ok {rc=0} 00:59:41.057124 --- ParallelTerminationStrategy: PID 21509 died... 00:59:41.075494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21509): Terminated: ok {rc=0} 00:59:41.160688 bus /sierra_3: Setting Powered False 00:59:42.259234 bus /sierra_3: Setting Powered False 00:59:43.374162 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 00:59:44.625831 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:59:44.632530 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 00:59:44.665241 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 00:59:44.691555 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 00:59:44.742106 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 00:59:44.774755 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 00:59:44.801066 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 00:59:45.353928 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 00:59:45.403321 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:45.414712 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:59:45.482305 tst mo_mt_call.py: using LAC 37444 00:59:45.600286 tst mo_mt_call.py: using RAC 214 00:59:45.718640 tst mo_mt_call.py: using CellId 37444 00:59:45.849125 tst mo_mt_call.py: using BVCI 37445 00:59:45.974022 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:45.986318 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:45.998264 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:46.010184 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:46.024096 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:46.039146 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:59:46.170785 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:59:46.319299 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:59:46.823852 run create_hlr_db(pid=21516): Launched 00:59:46.991208 bus /sierra_2: Setting Powered False 00:59:48.055788 run create_hlr_db(pid=21516): Terminated: ok {rc=0} 00:59:48.514092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21518): Launched 00:59:48.845256 run osmo-hlr_10.42.42.2(pid=21519): Launched 00:59:48.972058 run osmo-stp_10.42.42.5: Starting osmo-stp 00:59:49.539844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21521): Launched 00:59:49.870210 run osmo-stp_10.42.42.5(pid=21522): Launched 00:59:49.996650 run osmo-msc_10.42.42.6: Starting osmo-msc 00:59:50.590376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21524): Launched 00:59:50.921241 run osmo-msc_10.42.42.6(pid=21525): Launched 00:59:51.105647 run osmo-stp_10.42.42.5(pid=21522): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21522)] 00:59:51.243763 run osmo-stp_10.42.42.5(pid=21522): stdout: | (launched: 2022-12-14_00:59:49.809677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:51.382580 run osmo-stp_10.42.42.5(pid=21522): stderr: | [0;m[38;5;43m20221214005950002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005950002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005950003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005950003 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005950003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005950004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005950004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:51.520214 run osmo-stp_10.42.42.5(pid=21522): stdout: | (launched: 2022-12-14_00:59:49.809677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:59:51.651200 run osmo-stp_10.42.42.5(pid=21522): stderr: | [0;m[38;5;43m20221214005950002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214005950002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214005950003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214005950003 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214005950003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214005950004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214005950004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:59:51.807584 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21522): Process ended prematurely: osmo-stp_10.42.42.5(pid=21522) [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21522)] [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 00:59:51.817343 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 00:59:51.845263 run osmo-hlr_10.42.42.2(pid=21519): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21519)] 00:59:51.896130 run osmo-hlr_10.42.42.2(pid=21519): stdout: | (launched: 2022-12-14_00:59:48.784500) 00:59:51.948222 run osmo-hlr_10.42.42.2(pid=21519): stderr: | [0;m[1;31m20221214005948983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005948983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005948983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005948983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005948983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005948983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005948995 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005949004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005949004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005949004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:59:52.021088 run osmo-msc_10.42.42.6(pid=21525): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21525)] 00:59:52.070963 run osmo-msc_10.42.42.6(pid=21525): stdout: | (launched: 2022-12-14_00:59:50.860214) 00:59:52.122887 run osmo-msc_10.42.42.6(pid=21525): stderr: | [0;m[38;5;43m20221214005951181 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214005951181 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2e0e8d4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214005951181 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214005951181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214005951181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214005951182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214005951183 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214005951184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214005951184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214005951184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:59:52.174951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21518): Terminating (SIGTERM) 00:59:52.216999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21521): Terminating (SIGTERM) 00:59:52.258926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21524): Terminating (SIGTERM) 00:59:52.300914 --- ParallelTerminationStrategy: PID 21518 died... 00:59:52.321343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21518): Terminated: ok {rc=0} 00:59:52.367767 --- ParallelTerminationStrategy: PID 21521 died... 00:59:52.387504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21521): Terminated: ok {rc=0} 00:59:52.433714 --- ParallelTerminationStrategy: PID 21524 died... 00:59:52.453564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21524): Terminated: ok {rc=0} 00:59:52.542330 bus /sierra_3: Setting Powered False 00:59:53.641762 bus /sierra_3: Setting Powered False 00:59:54.754496 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 00:59:55.905901 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:55.918281 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:59:55.992652 tst mo_mt_call_osmux.py: using LAC 37445 00:59:56.120817 tst mo_mt_call_osmux.py: using RAC 215 00:59:56.246830 tst mo_mt_call_osmux.py: using CellId 37445 00:59:56.373103 tst mo_mt_call_osmux.py: using BVCI 37446 00:59:56.492266 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:56.503923 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:56.515401 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:56.526915 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:56.538784 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:59:56.550500 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:59:56.670106 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:59:56.787668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:59:57.262620 run create_hlr_db(pid=21527): Launched 00:59:57.390610 bus /sierra_2: Setting Powered False 00:59:58.451422 run create_hlr_db(pid=21527): Terminated: ok {rc=0} 00:59:58.900428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21529): Launched 00:59:59.230365 run osmo-hlr_10.42.42.2(pid=21530): Launched 00:59:59.358075 run osmo-stp_10.42.42.5: Starting osmo-stp 00:59:59.923572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21532): Launched 01:00:00.254114 run osmo-stp_10.42.42.5(pid=21533): Launched 01:00:00.381570 run osmo-msc_10.42.42.6: Starting osmo-msc 01:00:00.997771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21535): Launched 01:00:01.355146 run osmo-msc_10.42.42.6(pid=21536): Launched 01:00:01.750187 run osmo-stp_10.42.42.5(pid=21533): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21533)] 01:00:02.071010 run osmo-stp_10.42.42.5(pid=21533): stdout: | (launched: 2022-12-14_01:00:00.193564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:02.221055 run osmo-stp_10.42.42.5(pid=21533): stderr: | [0;m[38;5;43m20221214010000386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010000386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010000386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010000387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010000387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010000387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010000387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:02.362038 run osmo-stp_10.42.42.5(pid=21533): stdout: | (launched: 2022-12-14_01:00:00.193564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:02.496089 run osmo-stp_10.42.42.5(pid=21533): stderr: | [0;m[38;5;43m20221214010000386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010000386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010000386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010000387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010000387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010000387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010000387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:02.653169 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21533): Process ended prematurely: osmo-stp_10.42.42.5(pid=21533) [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21533)] [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 01:00:02.663167 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 01:00:02.691684 run osmo-hlr_10.42.42.2(pid=21530): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21530)] 01:00:02.743576 run osmo-hlr_10.42.42.2(pid=21530): stdout: | (launched: 2022-12-14_00:59:59.169793) 01:00:02.796786 run osmo-hlr_10.42.42.2(pid=21530): stderr: | [0;m[1;31m20221214005959369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214005959369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214005959369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214005959369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214005959369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214005959369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214005959381 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214005959390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214005959390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214005959391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:00:02.871277 run osmo-msc_10.42.42.6(pid=21536): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21536)] 01:00:02.922086 run osmo-msc_10.42.42.6(pid=21536): stdout: | (launched: 2022-12-14_01:00:01.290967) 01:00:02.974641 run osmo-msc_10.42.42.6(pid=21536): stderr: | [0;m[38;5;43m20221214010001835 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010001836 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa5ff8b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010001836 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010001836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010001836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010001836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010001842 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010001843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010001845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010001845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:00:03.027840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21529): Terminating (SIGTERM) 01:00:03.070597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21532): Terminating (SIGTERM) 01:00:03.113556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21535): Terminating (SIGTERM) 01:00:03.156406 --- ParallelTerminationStrategy: PID 21529 died... 01:00:03.176812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21529): Terminated: ok {rc=0} 01:00:03.224210 --- ParallelTerminationStrategy: PID 21532 died... 01:00:03.244634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21532): Terminated: ok {rc=0} 01:00:03.291765 --- ParallelTerminationStrategy: PID 21535 died... 01:00:03.312256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21535): Terminated: ok {rc=0} 01:00:03.402500 bus /sierra_3: Setting Powered False 01:00:04.500564 bus /sierra_3: Setting Powered False 01:00:05.616752 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 01:00:06.872011 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:00:06.879450 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 01:00:06.914637 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 01:00:06.943810 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 01:00:06.995870 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 01:00:07.030571 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 01:00:07.059295 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 01:00:07.608460 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 01:00:07.658265 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:07.669476 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:00:07.736871 tst mo_mt_call.py: using LAC 37446 01:00:07.854239 tst mo_mt_call.py: using RAC 216 01:00:07.971496 tst mo_mt_call.py: using CellId 37446 01:00:08.088540 tst mo_mt_call.py: using BVCI 37447 01:00:08.198719 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:08.209855 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:08.220674 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:08.231541 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:08.242595 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:08.253507 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:00:08.375475 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:00:08.497315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:00:09.005829 run create_hlr_db(pid=21544): Launched 01:00:09.131648 bus /sierra_2: Setting Powered False 01:00:10.196241 run create_hlr_db(pid=21544): Terminated: ok {rc=0} 01:00:10.638168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21546): Launched 01:00:10.947561 run osmo-hlr_10.42.42.2(pid=21547): Launched 01:00:11.064363 run osmo-stp_10.42.42.5: Starting osmo-stp 01:00:11.590755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21549): Launched 01:00:11.897085 run osmo-stp_10.42.42.5(pid=21550): Launched 01:00:12.012699 run osmo-msc_10.42.42.6: Starting osmo-msc 01:00:12.570446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21552): Launched 01:00:12.877735 run osmo-msc_10.42.42.6(pid=21553): Launched 01:00:13.048757 run osmo-stp_10.42.42.5(pid=21550): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21550)] 01:00:13.178469 run osmo-stp_10.42.42.5(pid=21550): stdout: | (launched: 2022-12-14_01:00:11.839968) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:13.307850 run osmo-stp_10.42.42.5(pid=21550): stderr: | [0;m[38;5;43m20221214010012012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010012013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010012013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010012013 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010012014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010012014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010012014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:13.435190 run osmo-stp_10.42.42.5(pid=21550): stdout: | (launched: 2022-12-14_01:00:11.839968) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:13.557810 run osmo-stp_10.42.42.5(pid=21550): stderr: | [0;m[38;5;43m20221214010012012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010012013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010012013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010012013 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010012014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010012014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010012014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:13.703711 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21550): Process ended prematurely: osmo-stp_10.42.42.5(pid=21550) [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21550)] [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 01:00:13.712834 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:00:13.739118 run osmo-hlr_10.42.42.2(pid=21547): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21547)] 01:00:13.786825 run osmo-hlr_10.42.42.2(pid=21547): stdout: | (launched: 2022-12-14_01:00:10.890184) 01:00:13.835647 run osmo-hlr_10.42.42.2(pid=21547): stderr: | [0;m[1;31m20221214010011065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010011065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010011065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010011065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010011065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010011065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010011077 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010011085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010011085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010011085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:00:13.903602 run osmo-msc_10.42.42.6(pid=21553): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21553)] 01:00:13.950416 run osmo-msc_10.42.42.6(pid=21553): stdout: | (launched: 2022-12-14_01:00:12.820723) 01:00:13.999213 run osmo-msc_10.42.42.6(pid=21553): stderr: | [0;m[38;5;43m20221214010013092 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010013092 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f77b80d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010013092 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010013092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010013092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010013092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010013094 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010013094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010013095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010013095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:00:14.048199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21546): Terminating (SIGTERM) 01:00:14.087447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21549): Terminating (SIGTERM) 01:00:14.126650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21552): Terminating (SIGTERM) 01:00:14.166061 --- ParallelTerminationStrategy: PID 21546 died... 01:00:14.185017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21546): Terminated: ok {rc=0} 01:00:14.228318 --- ParallelTerminationStrategy: PID 21549 died... 01:00:14.246840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21549): Terminated: ok {rc=0} 01:00:14.290067 --- ParallelTerminationStrategy: PID 21552 died... 01:00:14.308376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21552): Terminated: ok {rc=0} 01:00:14.393222 bus /sierra_3: Setting Powered False 01:00:15.492227 bus /sierra_3: Setting Powered False 01:00:16.617922 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 01:00:17.770553 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:17.782406 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:00:17.853359 tst mo_mt_call_osmux.py: using LAC 37447 01:00:17.973738 tst mo_mt_call_osmux.py: using RAC 217 01:00:18.094698 tst mo_mt_call_osmux.py: using CellId 37447 01:00:18.216251 tst mo_mt_call_osmux.py: using BVCI 37448 01:00:18.328155 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:18.339289 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:18.350320 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:18.361189 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:18.372122 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:00:18.383426 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:00:18.505159 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:00:18.623363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:00:19.098826 run create_hlr_db(pid=21555): Launched 01:00:19.225255 bus /sierra_2: Setting Powered False 01:00:20.285694 run create_hlr_db(pid=21555): Terminated: ok {rc=0} 01:00:20.736048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21557): Launched 01:00:21.067102 run osmo-hlr_10.42.42.2(pid=21558): Launched 01:00:21.193816 run osmo-stp_10.42.42.5: Starting osmo-stp 01:00:21.764050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21560): Launched 01:00:22.095713 run osmo-stp_10.42.42.5(pid=21561): Launched 01:00:22.223366 run osmo-msc_10.42.42.6: Starting osmo-msc 01:00:22.819161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21563): Launched 01:00:23.150698 run osmo-msc_10.42.42.6(pid=21564): Launched 01:00:23.335363 run osmo-stp_10.42.42.5(pid=21561): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21561)] 01:00:23.473961 run osmo-stp_10.42.42.5(pid=21561): stdout: | (launched: 2022-12-14_01:00:22.035058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:23.614037 run osmo-stp_10.42.42.5(pid=21561): stderr: | [0;m[38;5;43m20221214010022229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010022229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010022229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010022229 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010022230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010022230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010022230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:23.751540 run osmo-stp_10.42.42.5(pid=21561): stdout: | (launched: 2022-12-14_01:00:22.035058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:23.882304 run osmo-stp_10.42.42.5(pid=21561): stderr: | [0;m[38;5;43m20221214010022229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010022229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010022229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010022229 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010022230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010022230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010022230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:24.044170 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21561): Process ended prematurely: osmo-stp_10.42.42.5(pid=21561) [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21561)] [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 01:00:24.056117 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:00:24.085653 run osmo-hlr_10.42.42.2(pid=21558): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21558)] 01:00:24.137607 run osmo-hlr_10.42.42.2(pid=21558): stdout: | (launched: 2022-12-14_01:00:21.006504) 01:00:24.193073 run osmo-hlr_10.42.42.2(pid=21558): stderr: | [0;m[1;31m20221214010021205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010021205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010021205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010021205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010021205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010021205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010021221 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010021229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010021229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010021229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:00:24.266429 run osmo-msc_10.42.42.6(pid=21564): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21564)] 01:00:24.316797 run osmo-msc_10.42.42.6(pid=21564): stdout: | (launched: 2022-12-14_01:00:23.089942) 01:00:24.370018 run osmo-msc_10.42.42.6(pid=21564): stderr: | [0;m[38;5;43m20221214010023411 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010023411 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5b95354c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010023411 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010023411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010023411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010023412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010023413 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010023414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010023414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010023414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:00:24.422344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21557): Terminating (SIGTERM) 01:00:24.465193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21560): Terminating (SIGTERM) 01:00:24.507972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21563): Terminating (SIGTERM) 01:00:24.550748 --- ParallelTerminationStrategy: PID 21557 died... 01:00:24.571317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21557): Terminated: ok {rc=0} 01:00:24.618494 --- ParallelTerminationStrategy: PID 21560 died... 01:00:24.638438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21560): Terminated: ok {rc=0} 01:00:24.685185 --- ParallelTerminationStrategy: PID 21563 died... 01:00:24.705286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21563): Terminated: ok {rc=0} 01:00:24.794528 bus /sierra_3: Setting Powered False 01:00:25.894828 bus /sierra_3: Setting Powered False 01:00:27.015485 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:00:28.267151 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:00:28.273998 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:00:28.307069 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:00:28.334236 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:00:28.385486 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:00:28.418707 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:00:28.445105 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:00:28.996327 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:00:29.044862 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:29.056009 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:00:29.125068 tst mo_mt_call.py: using LAC 37448 01:00:29.244568 tst mo_mt_call.py: using RAC 218 01:00:29.365289 tst mo_mt_call.py: using CellId 37448 01:00:29.487540 tst mo_mt_call.py: using BVCI 37449 01:00:29.598926 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:29.610020 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:29.620836 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:29.631768 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:29.642682 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:29.653545 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:00:29.774426 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:00:29.891929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:00:30.367420 run create_hlr_db(pid=21571): Launched 01:00:30.494981 bus /sierra_2: Setting Powered False 01:00:31.573274 run create_hlr_db(pid=21571): Terminated: ok {rc=0} 01:00:32.065101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21573): Launched 01:00:32.388073 run osmo-hlr_10.42.42.2(pid=21574): Launched 01:00:32.506844 run osmo-stp_10.42.42.5: Starting osmo-stp 01:00:33.032435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21576): Launched 01:00:33.339303 run osmo-stp_10.42.42.5(pid=21577): Launched 01:00:33.456852 run osmo-msc_10.42.42.6: Starting osmo-msc 01:00:34.008101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21579): Launched 01:00:34.315608 run osmo-msc_10.42.42.6(pid=21580): Launched 01:00:34.487178 run osmo-stp_10.42.42.5(pid=21577): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21577)] 01:00:34.616380 run osmo-stp_10.42.42.5(pid=21577): stdout: | (launched: 2022-12-14_01:00:33.282460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:34.744448 run osmo-stp_10.42.42.5(pid=21577): stderr: | [0;m[38;5;43m20221214010033452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010033452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010033452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010033453 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010033453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010033453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010033453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:34.871170 run osmo-stp_10.42.42.5(pid=21577): stdout: | (launched: 2022-12-14_01:00:33.282460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:34.991898 run osmo-stp_10.42.42.5(pid=21577): stderr: | [0;m[38;5;43m20221214010033452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010033452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010033452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010033453 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010033453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010033453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010033453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:35.136558 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21577): Process ended prematurely: osmo-stp_10.42.42.5(pid=21577) [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21577)] [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:00:35.145643 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:00:35.171919 run osmo-hlr_10.42.42.2(pid=21574): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21574)] 01:00:35.219844 run osmo-hlr_10.42.42.2(pid=21574): stdout: | (launched: 2022-12-14_01:00:32.331043) 01:00:35.269051 run osmo-hlr_10.42.42.2(pid=21574): stderr: | [0;m[1;31m20221214010032507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010032507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010032507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010032507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010032507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010032507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010032520 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010032529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010032529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010032530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:00:35.337344 run osmo-msc_10.42.42.6(pid=21580): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21580)] 01:00:35.384717 run osmo-msc_10.42.42.6(pid=21580): stdout: | (launched: 2022-12-14_01:00:34.258340) 01:00:35.433592 run osmo-msc_10.42.42.6(pid=21580): stderr: | [0;m[38;5;43m20221214010034532 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010034532 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd316ab8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010034532 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010034532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010034532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010034533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010034534 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010034535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010034535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010034535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:00:35.482796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21573): Terminating (SIGTERM) 01:00:35.522284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21576): Terminating (SIGTERM) 01:00:35.561717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21579): Terminating (SIGTERM) 01:00:35.601318 --- ParallelTerminationStrategy: PID 21573 died... 01:00:35.620390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21573): Terminated: ok {rc=0} 01:00:35.664058 --- ParallelTerminationStrategy: PID 21576 died... 01:00:35.682610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21576): Terminated: ok {rc=0} 01:00:35.726007 --- ParallelTerminationStrategy: PID 21579 died... 01:00:35.744571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21579): Terminated: ok {rc=0} 01:00:35.831284 bus /sierra_3: Setting Powered False 01:00:36.931015 bus /sierra_3: Setting Powered False 01:00:38.046784 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:00:39.194423 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:39.206403 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:00:39.275968 tst mo_mt_call_osmux.py: using LAC 37449 01:00:39.400142 tst mo_mt_call_osmux.py: using RAC 219 01:00:39.520119 tst mo_mt_call_osmux.py: using CellId 37449 01:00:39.638495 tst mo_mt_call_osmux.py: using BVCI 37450 01:00:39.751405 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:39.762744 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:39.773888 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:39.784906 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:39.796131 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:00:39.807216 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:00:39.922108 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:00:40.044310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:00:40.522276 run create_hlr_db(pid=21582): Launched 01:00:40.650293 bus /sierra_2: Setting Powered False 01:00:41.711438 run create_hlr_db(pid=21582): Terminated: ok {rc=0} 01:00:42.139358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21584): Launched 01:00:42.446996 run osmo-hlr_10.42.42.2(pid=21585): Launched 01:00:42.564105 run osmo-stp_10.42.42.5: Starting osmo-stp 01:00:43.109674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21587): Launched 01:00:43.416807 run osmo-stp_10.42.42.5(pid=21588): Launched 01:00:43.534097 run osmo-msc_10.42.42.6: Starting osmo-msc 01:00:44.087089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21590): Launched 01:00:44.395596 run osmo-msc_10.42.42.6(pid=21591): Launched 01:00:44.567596 run osmo-stp_10.42.42.5(pid=21588): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21588)] 01:00:44.696910 run osmo-stp_10.42.42.5(pid=21588): stdout: | (launched: 2022-12-14_01:00:43.359897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:44.825654 run osmo-stp_10.42.42.5(pid=21588): stderr: | [0;m[38;5;43m20221214010043533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010043534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010043534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010043534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010043535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010043535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010043535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:44.952896 run osmo-stp_10.42.42.5(pid=21588): stdout: | (launched: 2022-12-14_01:00:43.359897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:45.074188 run osmo-stp_10.42.42.5(pid=21588): stderr: | [0;m[38;5;43m20221214010043533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010043534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010043534 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010043534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010043535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010043535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010043535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:45.219757 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21588): Process ended prematurely: osmo-stp_10.42.42.5(pid=21588) [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21588)] [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:00:45.228819 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:00:45.255089 run osmo-hlr_10.42.42.2(pid=21585): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21585)] 01:00:45.302442 run osmo-hlr_10.42.42.2(pid=21585): stdout: | (launched: 2022-12-14_01:00:42.389935) 01:00:45.351486 run osmo-hlr_10.42.42.2(pid=21585): stderr: | [0;m[1;31m20221214010042566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010042567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010042567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010042567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010042567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010042567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010042579 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010042587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010042588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010042588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:00:45.419893 run osmo-msc_10.42.42.6(pid=21591): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21591)] 01:00:45.466941 run osmo-msc_10.42.42.6(pid=21591): stdout: | (launched: 2022-12-14_01:00:44.338441) 01:00:45.515518 run osmo-msc_10.42.42.6(pid=21591): stderr: | [0;m[38;5;43m20221214010044611 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010044612 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe8bd730c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010044612 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010044612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010044612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010044612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010044614 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010044614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010044615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010044615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:00:45.564457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21584): Terminating (SIGTERM) 01:00:45.603744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21587): Terminating (SIGTERM) 01:00:45.643169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21590): Terminating (SIGTERM) 01:00:45.682692 --- ParallelTerminationStrategy: PID 21584 died... 01:00:45.701666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21584): Terminated: ok {rc=0} 01:00:45.745386 --- ParallelTerminationStrategy: PID 21587 died... 01:00:45.763844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21587): Terminated: ok {rc=0} 01:00:45.807198 --- ParallelTerminationStrategy: PID 21590 died... 01:00:45.825837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21590): Terminated: ok {rc=0} 01:00:45.944136 bus /sierra_3: Setting Powered False 01:00:47.053642 bus /sierra_3: Setting Powered False 01:00:48.173828 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:00:49.424248 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:00:49.431186 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:00:49.463805 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:00:49.490126 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:00:49.541211 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:00:49.574163 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:00:49.600593 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:00:50.162129 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:00:50.215713 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:00:50.227655 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:00:50.299237 tst mo_mt_call.py: using LAC 37450 01:00:50.429179 tst mo_mt_call.py: using RAC 220 01:00:50.557768 tst mo_mt_call.py: using CellId 37450 01:00:50.679324 tst mo_mt_call.py: using BVCI 37451 01:00:50.789636 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:00:50.801051 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:00:50.812185 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:00:50.823438 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:00:50.834737 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:00:50.845736 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:00:50.966295 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:00:51.083691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:00:51.559898 run create_hlr_db(pid=21597): Launched 01:00:51.684890 bus /sierra_2: Setting Powered False 01:00:52.745617 run create_hlr_db(pid=21597): Terminated: ok {rc=0} 01:00:53.173124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21599): Launched 01:00:53.479038 run osmo-hlr_10.42.42.2(pid=21600): Launched 01:00:53.595724 run osmo-stp_10.42.42.5: Starting osmo-stp 01:00:54.118959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21602): Launched 01:00:54.425276 run osmo-stp_10.42.42.5(pid=21603): Launched 01:00:54.541416 run osmo-msc_10.42.42.6: Starting osmo-msc 01:00:55.095865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21605): Launched 01:00:55.404117 run osmo-msc_10.42.42.6(pid=21606): Launched 01:00:55.575015 run osmo-stp_10.42.42.5(pid=21603): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21603)] 01:00:55.703676 run osmo-stp_10.42.42.5(pid=21603): stdout: | (launched: 2022-12-14_01:00:54.368248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:55.832470 run osmo-stp_10.42.42.5(pid=21603): stderr: | [0;m[38;5;43m20221214010054542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010054542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010054542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010054543 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010054543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010054543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010054543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:55.960002 run osmo-stp_10.42.42.5(pid=21603): stdout: | (launched: 2022-12-14_01:00:54.368248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:00:56.081298 run osmo-stp_10.42.42.5(pid=21603): stderr: | [0;m[38;5;43m20221214010054542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010054542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010054542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010054543 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010054543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010054543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010054543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:00:56.226810 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21603): Process ended prematurely: osmo-stp_10.42.42.5(pid=21603) [trial-2397↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21603)] [trial-2397↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:00:56.235790 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:00:56.262436 run osmo-hlr_10.42.42.2(pid=21600): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21600)] 01:00:56.309965 run osmo-hlr_10.42.42.2(pid=21600): stdout: | (launched: 2022-12-14_01:00:53.422298) 01:00:56.358958 run osmo-hlr_10.42.42.2(pid=21600): stderr: | [0;m[1;31m20221214010053600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010053600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010053600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010053600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010053600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010053600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010053616 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010053627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010053627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010053627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:00:56.427697 run osmo-msc_10.42.42.6(pid=21606): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21606)] 01:00:56.475398 run osmo-msc_10.42.42.6(pid=21606): stdout: | (launched: 2022-12-14_01:00:55.347039) 01:00:56.524213 run osmo-msc_10.42.42.6(pid=21606): stderr: | [0;m[38;5;43m20221214010055620 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010055620 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f05a0795c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010055620 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010055620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010055620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010055620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010055622 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010055622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010055623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010055623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:00:56.573458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21599): Terminating (SIGTERM) 01:00:56.612835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21602): Terminating (SIGTERM) 01:00:56.652136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21605): Terminating (SIGTERM) 01:00:56.692109 --- ParallelTerminationStrategy: PID 21599 died... 01:00:56.711373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21599): Terminated: ok {rc=0} 01:00:56.755295 --- ParallelTerminationStrategy: PID 21602 died... 01:00:56.773766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21602): Terminated: ok {rc=0} 01:00:56.817201 --- ParallelTerminationStrategy: PID 21605 died... 01:00:56.835776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21605): Terminated: ok {rc=0} 01:00:56.921492 bus /sierra_3: Setting Powered False 01:00:58.020793 bus /sierra_3: Setting Powered False 01:00:59.135838 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:01:00.282316 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:01:00.294298 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:01:00.365274 tst mo_mt_call_osmux.py: using LAC 37451 01:01:00.487009 tst mo_mt_call_osmux.py: using RAC 221 01:01:00.609672 tst mo_mt_call_osmux.py: using CellId 37451 01:01:00.732417 tst mo_mt_call_osmux.py: using BVCI 37452 01:01:00.854121 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:01:00.873875 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:01:00.888859 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:01:00.908482 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:01:00.923532 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:01:00.938696 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:01:01.078327 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:01:01.211272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:01:01.739578 run create_hlr_db(pid=21608): Launched 01:01:01.902780 bus /sierra_2: Setting Powered False 01:01:02.964209 run create_hlr_db(pid=21608): Terminated: ok {rc=0} 01:01:03.393783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21610): Launched 01:01:03.702496 run osmo-hlr_10.42.42.2(pid=21611): Launched 01:01:03.818626 run osmo-stp_10.42.42.5: Starting osmo-stp 01:01:04.367001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21613): Launched 01:01:04.674149 run osmo-stp_10.42.42.5(pid=21614): Launched 01:01:04.790735 run osmo-msc_10.42.42.6: Starting osmo-msc 01:01:05.343320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21616): Launched 01:01:05.652038 run osmo-msc_10.42.42.6(pid=21617): Launched 01:01:05.822869 run osmo-stp_10.42.42.5(pid=21614): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21614)] 01:01:05.951283 run osmo-stp_10.42.42.5(pid=21614): stdout: | (launched: 2022-12-14_01:01:04.617341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:06.079941 run osmo-stp_10.42.42.5(pid=21614): stderr: | [0;m[38;5;43m20221214010104789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010104789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010104790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010104790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010104790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010104791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010104791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:06.207596 run osmo-stp_10.42.42.5(pid=21614): stdout: | (launched: 2022-12-14_01:01:04.617341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:06.328542 run osmo-stp_10.42.42.5(pid=21614): stderr: | [0;m[38;5;43m20221214010104789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010104789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010104790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010104790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010104790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010104791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010104791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:06.473943 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21614): Process ended prematurely: osmo-stp_10.42.42.5(pid=21614) [trial-2397↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21614)] [trial-2397↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:01:06.483410 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:01:06.509919 run osmo-hlr_10.42.42.2(pid=21611): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21611)] 01:01:06.557383 run osmo-hlr_10.42.42.2(pid=21611): stdout: | (launched: 2022-12-14_01:01:03.645349) 01:01:06.606642 run osmo-hlr_10.42.42.2(pid=21611): stderr: | [0;m[1;31m20221214010103821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010103821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010103821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010103821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010103821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010103821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010103834 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010103844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010103844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010103844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:01:06.675532 run osmo-msc_10.42.42.6(pid=21617): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21617)] 01:01:06.723001 run osmo-msc_10.42.42.6(pid=21617): stdout: | (launched: 2022-12-14_01:01:05.595080) 01:01:06.772683 run osmo-msc_10.42.42.6(pid=21617): stderr: | [0;m[38;5;43m20221214010105866 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010105866 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f37f19efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010105866 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010105866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010105866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010105867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010105868 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010105869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010105869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010105869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:01:06.822449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21610): Terminating (SIGTERM) 01:01:06.861790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21613): Terminating (SIGTERM) 01:01:06.901309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21616): Terminating (SIGTERM) 01:01:06.941332 --- ParallelTerminationStrategy: PID 21610 died... 01:01:06.960499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21610): Terminated: ok {rc=0} 01:01:07.004135 --- ParallelTerminationStrategy: PID 21613 died... 01:01:07.022743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21613): Terminated: ok {rc=0} 01:01:07.066224 --- ParallelTerminationStrategy: PID 21616 died... 01:01:07.084658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21616): Terminated: ok {rc=0} 01:01:07.167900 bus /sierra_3: Setting Powered False 01:01:08.266557 bus /sierra_3: Setting Powered False 01:01:09.383814 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:01:10.635130 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:01:10.640876 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:01:10.673790 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 01:01:10.700516 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 01:01:10.751710 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:01:10.784464 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 01:01:10.811502 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 01:01:11.360805 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 01:01:11.410254 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:11.421291 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:01:11.491706 tst mo_mt_call.py: using LAC 37452 01:01:11.611722 tst mo_mt_call.py: using RAC 222 01:01:11.744713 tst mo_mt_call.py: using CellId 37452 01:01:11.874459 tst mo_mt_call.py: using BVCI 37453 01:01:11.995634 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:12.007107 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:12.018446 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:12.029723 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:12.041409 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:12.053048 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:01:12.171099 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:01:12.291970 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:01:12.802914 run create_hlr_db(pid=21622): Launched 01:01:12.930524 bus /sierra_2: Setting Powered False 01:01:13.995289 run create_hlr_db(pid=21622): Terminated: ok {rc=0} 01:01:14.454382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21624): Launched 01:01:14.785927 run osmo-hlr_10.42.42.2(pid=21625): Launched 01:01:14.913614 run osmo-stp_10.42.42.5: Starting osmo-stp 01:01:15.483001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21627): Launched 01:01:15.814970 run osmo-stp_10.42.42.5(pid=21628): Launched 01:01:16.128241 run osmo-msc_10.42.42.6: Starting osmo-msc 01:01:16.928197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21630): Launched 01:01:17.270636 run osmo-msc_10.42.42.6(pid=21631): Launched 01:01:17.463160 run osmo-stp_10.42.42.5(pid=21628): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21628)] 01:01:17.601900 run osmo-stp_10.42.42.5(pid=21628): stdout: | (launched: 2022-12-14_01:01:15.754290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:17.740313 run osmo-stp_10.42.42.5(pid=21628): stderr: | [0;m[38;5;43m20221214010116020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010116020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010116021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010116021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010116022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010116022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010116022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:17.878193 run osmo-stp_10.42.42.5(pid=21628): stdout: | (launched: 2022-12-14_01:01:15.754290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:18.008928 run osmo-stp_10.42.42.5(pid=21628): stderr: | [0;m[38;5;43m20221214010116020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010116020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010116021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010116021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010116022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010116022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010116022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:18.165482 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21628): Process ended prematurely: osmo-stp_10.42.42.5(pid=21628) [trial-2397↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21628)] [trial-2397↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 01:01:18.175266 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 01:01:18.203411 run osmo-hlr_10.42.42.2(pid=21625): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21625)] 01:01:18.254823 run osmo-hlr_10.42.42.2(pid=21625): stdout: | (launched: 2022-12-14_01:01:14.725015) 01:01:18.307360 run osmo-hlr_10.42.42.2(pid=21625): stderr: | [0;m[1;31m20221214010114924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010114924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010114924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010114924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010114924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010114924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010114938 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010114946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010114947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010114947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:01:18.380648 run osmo-msc_10.42.42.6(pid=21631): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21631)] 01:01:18.430987 run osmo-msc_10.42.42.6(pid=21631): stdout: | (launched: 2022-12-14_01:01:17.210246) 01:01:18.483599 run osmo-msc_10.42.42.6(pid=21631): stderr: | [0;m[38;5;43m20221214010117549 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010117549 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffbdbd31c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010117549 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010117549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010117549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010117549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010117551 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010117551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010117551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010117552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:01:18.536876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21624): Terminating (SIGTERM) 01:01:18.579137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21627): Terminating (SIGTERM) 01:01:18.621519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21630): Terminating (SIGTERM) 01:01:18.663961 --- ParallelTerminationStrategy: PID 21624 died... 01:01:18.684452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21624): Terminated: ok {rc=0} 01:01:18.731372 --- ParallelTerminationStrategy: PID 21627 died... 01:01:18.751322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21627): Terminated: ok {rc=0} 01:01:18.798079 --- ParallelTerminationStrategy: PID 21630 died... 01:01:18.818038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21630): Terminated: ok {rc=0} 01:01:18.907567 bus /sierra_3: Setting Powered False 01:01:20.007159 bus /sierra_3: Setting Powered False 01:01:21.123861 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 01:01:22.270066 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:22.281728 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:01:22.357090 tst mo_mt_call_osmux.py: using LAC 37453 01:01:22.474999 tst mo_mt_call_osmux.py: using RAC 223 01:01:22.594203 tst mo_mt_call_osmux.py: using CellId 37453 01:01:22.711523 tst mo_mt_call_osmux.py: using BVCI 37454 01:01:22.822153 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:22.833534 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:22.844511 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:22.855402 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:22.866540 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:01:22.877653 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:01:22.999492 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:01:23.117129 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:01:23.590519 run create_hlr_db(pid=21633): Launched 01:01:23.716218 bus /sierra_2: Setting Powered False 01:01:24.777052 run create_hlr_db(pid=21633): Terminated: ok {rc=0} 01:01:25.204066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21635): Launched 01:01:25.509947 run osmo-hlr_10.42.42.2(pid=21636): Launched 01:01:25.625465 run osmo-stp_10.42.42.5: Starting osmo-stp 01:01:26.147668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21638): Launched 01:01:26.454039 run osmo-stp_10.42.42.5(pid=21639): Launched 01:01:26.570021 run osmo-msc_10.42.42.6: Starting osmo-msc 01:01:27.124057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21641): Launched 01:01:27.430416 run osmo-msc_10.42.42.6(pid=21642): Launched 01:01:27.601843 run osmo-stp_10.42.42.5(pid=21639): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21639)] 01:01:27.729978 run osmo-stp_10.42.42.5(pid=21639): stdout: | (launched: 2022-12-14_01:01:26.396685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:27.858590 run osmo-stp_10.42.42.5(pid=21639): stderr: | [0;m[38;5;43m20221214010126568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010126568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010126568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010126569 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010126570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010126570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010126570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:27.985542 run osmo-stp_10.42.42.5(pid=21639): stdout: | (launched: 2022-12-14_01:01:26.396685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:28.106565 run osmo-stp_10.42.42.5(pid=21639): stderr: | [0;m[38;5;43m20221214010126568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010126568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010126568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010126569 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010126570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010126570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010126570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:28.251659 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21639): Process ended prematurely: osmo-stp_10.42.42.5(pid=21639) [trial-2397↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21639)] [trial-2397↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 01:01:28.260914 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 01:01:28.287722 run osmo-hlr_10.42.42.2(pid=21636): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21636)] 01:01:28.335942 run osmo-hlr_10.42.42.2(pid=21636): stdout: | (launched: 2022-12-14_01:01:25.452855) 01:01:28.385764 run osmo-hlr_10.42.42.2(pid=21636): stderr: | [0;m[1;31m20221214010125631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010125631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010125631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010125631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010125631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010125631 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010125643 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010125652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010125652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010125652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:01:28.455306 run osmo-msc_10.42.42.6(pid=21642): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21642)] 01:01:28.503165 run osmo-msc_10.42.42.6(pid=21642): stdout: | (launched: 2022-12-14_01:01:27.373060) 01:01:28.552690 run osmo-msc_10.42.42.6(pid=21642): stderr: | [0;m[38;5;43m20221214010127645 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010127645 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f532b079c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010127645 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010127646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010127646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010127646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010127648 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010127648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010127648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010127648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:01:28.602626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21635): Terminating (SIGTERM) 01:01:28.642581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21638): Terminating (SIGTERM) 01:01:28.682367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21641): Terminating (SIGTERM) 01:01:28.722675 --- ParallelTerminationStrategy: PID 21635 died... 01:01:28.742124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21635): Terminated: ok {rc=0} 01:01:28.786578 --- ParallelTerminationStrategy: PID 21638 died... 01:01:28.805632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21638): Terminated: ok {rc=0} 01:01:28.849910 --- ParallelTerminationStrategy: PID 21641 died... 01:01:28.868923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21641): Terminated: ok {rc=0} 01:01:28.955200 bus /sierra_3: Setting Powered False 01:01:30.055546 bus /sierra_3: Setting Powered False 01:01:31.185220 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 01:01:32.433858 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:01:32.438830 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 01:01:32.471045 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 01:01:32.497439 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 01:01:32.549842 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 01:01:32.584110 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 01:01:32.611513 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 01:01:33.155591 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 01:01:33.203330 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:33.214319 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 01:01:33.264588 tst mo_mt_call.py: using LAC 37454 01:01:33.382730 tst mo_mt_call.py: using RAC 224 01:01:33.501546 tst mo_mt_call.py: using CellId 37454 01:01:33.618566 tst mo_mt_call.py: using BVCI 37455 01:01:33.726414 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:33.737414 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:33.747889 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:33.758544 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:33.769146 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:33.779852 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 01:01:33.899957 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 01:01:34.015153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:01:34.479743 run create_hlr_db(pid=21647): Launched 01:01:34.602503 bus /sierra_2: Setting Powered False 01:01:35.661766 run create_hlr_db(pid=21647): Terminated: ok {rc=0} 01:01:36.079171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21649): Launched 01:01:36.378542 run osmo-hlr_10.42.42.2(pid=21650): Launched 01:01:36.491236 run osmo-stp_10.42.42.5: Starting osmo-stp 01:01:37.006716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21652): Launched 01:01:37.307152 run osmo-stp_10.42.42.5(pid=21653): Launched 01:01:37.419932 run osmo-msc_10.42.42.6: Starting osmo-msc 01:01:37.961682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21655): Launched 01:01:38.262423 run osmo-msc_10.42.42.6(pid=21656): Launched 01:01:38.428298 run osmo-stp_10.42.42.5(pid=21653): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21653)] 01:01:38.554365 run osmo-stp_10.42.42.5(pid=21653): stdout: | (launched: 2022-12-14_01:01:37.251791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:38.680236 run osmo-stp_10.42.42.5(pid=21653): stderr: | [0;m[38;5;43m20221214010137420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010137420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010137420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010137421 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010137421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010137421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010137421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:38.804531 run osmo-stp_10.42.42.5(pid=21653): stdout: | (launched: 2022-12-14_01:01:37.251791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:38.922812 run osmo-stp_10.42.42.5(pid=21653): stderr: | [0;m[38;5;43m20221214010137420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010137420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010137420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010137421 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010137421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010137421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010137421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:39.065488 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21653): Process ended prematurely: osmo-stp_10.42.42.5(pid=21653) [trial-2397↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21653)] [trial-2397↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 01:01:39.074213 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 01:01:39.100256 run osmo-hlr_10.42.42.2(pid=21650): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21650)] 01:01:39.147040 run osmo-hlr_10.42.42.2(pid=21650): stdout: | (launched: 2022-12-14_01:01:36.323051) 01:01:39.195681 run osmo-hlr_10.42.42.2(pid=21650): stderr: | [0;m[1;31m20221214010136494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010136494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010136494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010136494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010136494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010136494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010136506 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010136514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010136514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010136514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:01:39.263375 run osmo-msc_10.42.42.6(pid=21656): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21656)] 01:01:39.310203 run osmo-msc_10.42.42.6(pid=21656): stdout: | (launched: 2022-12-14_01:01:38.206613) 01:01:39.358610 run osmo-msc_10.42.42.6(pid=21656): stderr: | [0;m[38;5;43m20221214010138472 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010138473 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f077d0f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010138473 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010138473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010138473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010138473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010138475 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010138475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010138475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010138476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:01:39.407479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21649): Terminating (SIGTERM) 01:01:39.446535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21652): Terminating (SIGTERM) 01:01:39.485840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21655): Terminating (SIGTERM) 01:01:39.529336 --- ParallelTerminationStrategy: PID 21649 died... 01:01:39.547930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21649): Terminated: ok {rc=0} 01:01:39.591355 --- ParallelTerminationStrategy: PID 21652 died... 01:01:39.609631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21652): Terminated: ok {rc=0} 01:01:39.652750 --- ParallelTerminationStrategy: PID 21655 died... 01:01:39.671086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21655): Terminated: ok {rc=0} 01:01:39.754931 bus /sierra_3: Setting Powered False 01:01:40.853452 bus /sierra_3: Setting Powered False 01:01:41.969320 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 01:01:43.113360 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:43.124514 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 01:01:43.172909 tst mo_mt_call_osmux.py: using LAC 37455 01:01:43.287767 tst mo_mt_call_osmux.py: using RAC 225 01:01:43.411454 tst mo_mt_call_osmux.py: using CellId 37455 01:01:43.533833 tst mo_mt_call_osmux.py: using BVCI 37456 01:01:43.648724 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:43.660310 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:43.671830 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:43.682941 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:43.694471 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 01:01:43.706030 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 01:01:43.821662 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 01:01:43.940015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:01:44.432004 run create_hlr_db(pid=21658): Launched 01:01:44.553195 bus /sierra_2: Setting Powered False 01:01:45.615810 run create_hlr_db(pid=21658): Terminated: ok {rc=0} 01:01:46.077919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21660): Launched 01:01:46.396442 run osmo-hlr_10.42.42.2(pid=21661): Launched 01:01:46.639385 run osmo-stp_10.42.42.5: Starting osmo-stp 01:01:47.245049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21663): Launched 01:01:47.546197 run osmo-stp_10.42.42.5(pid=21664): Launched 01:01:47.661109 run osmo-msc_10.42.42.6: Starting osmo-msc 01:01:48.201375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21666): Launched 01:01:48.500421 run osmo-msc_10.42.42.6(pid=21667): Launched 01:01:48.668122 run osmo-stp_10.42.42.5(pid=21664): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21664)] 01:01:48.794366 run osmo-stp_10.42.42.5(pid=21664): stdout: | (launched: 2022-12-14_01:01:47.490189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:48.920052 run osmo-stp_10.42.42.5(pid=21664): stderr: | [0;m[38;5;43m20221214010147656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010147656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010147656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010147657 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010147657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010147657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010147657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:49.043679 run osmo-stp_10.42.42.5(pid=21664): stdout: | (launched: 2022-12-14_01:01:47.490189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:49.162522 run osmo-stp_10.42.42.5(pid=21664): stderr: | [0;m[38;5;43m20221214010147656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010147656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010147656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010147657 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010147657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010147657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010147657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:49.304041 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21664): Process ended prematurely: osmo-stp_10.42.42.5(pid=21664) [trial-2397↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21664)] [trial-2397↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 01:01:49.312818 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:01:49.338683 run osmo-hlr_10.42.42.2(pid=21661): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21661)] 01:01:49.385399 run osmo-hlr_10.42.42.2(pid=21661): stdout: | (launched: 2022-12-14_01:01:46.326052) 01:01:49.433753 run osmo-hlr_10.42.42.2(pid=21661): stderr: | [0;m[1;31m20221214010146669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010146669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010146669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010146669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010146669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010146669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010146692 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010146704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010146704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010146704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:01:49.501268 run osmo-msc_10.42.42.6(pid=21667): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21667)] 01:01:49.548131 run osmo-msc_10.42.42.6(pid=21667): stdout: | (launched: 2022-12-14_01:01:48.444630) 01:01:49.597192 run osmo-msc_10.42.42.6(pid=21667): stderr: | [0;m[38;5;43m20221214010148713 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010148713 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8ace0bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010148713 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010148713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010148713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010148714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010148715 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010148716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010148716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010148716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:01:49.645972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21660): Terminating (SIGTERM) 01:01:49.685111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21663): Terminating (SIGTERM) 01:01:49.724193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21666): Terminating (SIGTERM) 01:01:49.763474 --- ParallelTerminationStrategy: PID 21660 died... 01:01:49.782325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21660): Terminated: ok {rc=0} 01:01:49.825429 --- ParallelTerminationStrategy: PID 21663 died... 01:01:49.843591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21663): Terminated: ok {rc=0} 01:01:49.886393 --- ParallelTerminationStrategy: PID 21666 died... 01:01:49.904583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21666): Terminated: ok {rc=0} 01:01:49.989691 bus /sierra_3: Setting Powered False 01:01:51.090517 bus /sierra_3: Setting Powered False 01:01:52.206005 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 01:01:53.454531 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:01:53.460447 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 01:01:53.492735 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 01:01:53.519187 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 01:01:53.571517 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 01:01:53.604379 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 01:01:53.630755 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 01:01:54.181580 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 01:01:54.230284 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:01:54.241542 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:01:54.294294 tst mo_mt_call.py: using LAC 37456 01:01:54.412401 tst mo_mt_call.py: using RAC 226 01:01:54.531197 tst mo_mt_call.py: using CellId 37456 01:01:54.658708 tst mo_mt_call.py: using BVCI 37457 01:01:54.775404 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:01:54.787242 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:01:54.798943 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:01:54.810671 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:01:54.822893 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:01:54.835078 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:01:54.950807 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:01:55.070175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:01:55.567492 run create_hlr_db(pid=21672): Launched 01:01:55.690142 bus /sierra_2: Setting Powered False 01:01:56.753805 run create_hlr_db(pid=21672): Terminated: ok {rc=0} 01:01:57.183029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21674): Launched 01:01:57.484109 run osmo-hlr_10.42.42.2(pid=21675): Launched 01:01:57.598703 run osmo-stp_10.42.42.5: Starting osmo-stp 01:01:58.113718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21677): Launched 01:01:58.414091 run osmo-stp_10.42.42.5(pid=21678): Launched 01:01:58.527857 run osmo-msc_10.42.42.6: Starting osmo-msc 01:01:59.068707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21680): Launched 01:01:59.369383 run osmo-msc_10.42.42.6(pid=21681): Launched 01:01:59.535914 run osmo-stp_10.42.42.5(pid=21678): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21678)] 01:01:59.662180 run osmo-stp_10.42.42.5(pid=21678): stdout: | (launched: 2022-12-14_01:01:58.358043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:01:59.788119 run osmo-stp_10.42.42.5(pid=21678): stderr: | [0;m[38;5;43m20221214010158525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010158525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010158525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010158526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010158526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010158526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010158526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:01:59.912620 run osmo-stp_10.42.42.5(pid=21678): stdout: | (launched: 2022-12-14_01:01:58.358043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:00.038730 run osmo-stp_10.42.42.5(pid=21678): stderr: | [0;m[38;5;43m20221214010158525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010158525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010158525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010158526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010158526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010158526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010158526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:00.180087 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21678): Process ended prematurely: osmo-stp_10.42.42.5(pid=21678) [trial-2397↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21678)] [trial-2397↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 01:02:00.189111 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 01:02:00.214946 run osmo-hlr_10.42.42.2(pid=21675): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21675)] 01:02:00.261598 run osmo-hlr_10.42.42.2(pid=21675): stdout: | (launched: 2022-12-14_01:01:57.428072) 01:02:00.309901 run osmo-hlr_10.42.42.2(pid=21675): stderr: | [0;m[1;31m20221214010157602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010157602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010157602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010157602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010157602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010157602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010157614 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010157624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010157624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010157625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:02:00.377165 run osmo-msc_10.42.42.6(pid=21681): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21681)] 01:02:00.423427 run osmo-msc_10.42.42.6(pid=21681): stdout: | (launched: 2022-12-14_01:01:59.313432) 01:02:00.471233 run osmo-msc_10.42.42.6(pid=21681): stderr: | [0;m[38;5;43m20221214010159585 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010159585 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe4f0a0dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010159585 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010159585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010159585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010159586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010159587 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010159588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010159588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010159588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:02:00.519702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21674): Terminating (SIGTERM) 01:02:00.558678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21677): Terminating (SIGTERM) 01:02:00.597439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21680): Terminating (SIGTERM) 01:02:00.637099 --- ParallelTerminationStrategy: PID 21674 died... 01:02:00.655999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21674): Terminated: ok {rc=0} 01:02:00.699109 --- ParallelTerminationStrategy: PID 21677 died... 01:02:00.717347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21677): Terminated: ok {rc=0} 01:02:00.759965 --- ParallelTerminationStrategy: PID 21680 died... 01:02:00.778198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21680): Terminated: ok {rc=0} 01:02:00.862552 bus /sierra_3: Setting Powered False 01:02:01.972859 bus /sierra_3: Setting Powered False 01:02:03.093250 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 01:02:04.242953 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:02:04.255557 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:02:04.310698 tst mo_mt_call_osmux.py: using LAC 37457 01:02:04.436643 tst mo_mt_call_osmux.py: using RAC 227 01:02:04.565388 tst mo_mt_call_osmux.py: using CellId 37457 01:02:04.689167 tst mo_mt_call_osmux.py: using BVCI 37458 01:02:04.804183 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:02:04.816086 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:02:04.827849 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:02:04.839556 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:02:04.851830 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:02:04.863995 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:02:04.979294 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:02:05.100527 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:02:05.595553 run create_hlr_db(pid=21683): Launched 01:02:05.716633 bus /sierra_2: Setting Powered False 01:02:06.779445 run create_hlr_db(pid=21683): Terminated: ok {rc=0} 01:02:07.222405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21685): Launched 01:02:07.541674 run osmo-hlr_10.42.42.2(pid=21686): Launched 01:02:07.663569 run osmo-stp_10.42.42.5: Starting osmo-stp 01:02:08.212696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21688): Launched 01:02:08.530207 run osmo-stp_10.42.42.5(pid=21689): Launched 01:02:08.651754 run osmo-msc_10.42.42.6: Starting osmo-msc 01:02:09.229397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21691): Launched 01:02:09.549263 run osmo-msc_10.42.42.6(pid=21692): Launched 01:02:09.726538 run osmo-stp_10.42.42.5(pid=21689): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21689)] 01:02:09.860550 run osmo-stp_10.42.42.5(pid=21689): stdout: | (launched: 2022-12-14_01:02:08.471761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:09.995413 run osmo-stp_10.42.42.5(pid=21689): stderr: | [0;m[38;5;43m20221214010208658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010208658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010208658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010208658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010208659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010208659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010208659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:10.128457 run osmo-stp_10.42.42.5(pid=21689): stdout: | (launched: 2022-12-14_01:02:08.471761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:10.259350 run osmo-stp_10.42.42.5(pid=21689): stderr: | [0;m[38;5;43m20221214010208658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010208658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010208658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010208658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010208659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010208659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010208659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:10.411186 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21689): Process ended prematurely: osmo-stp_10.42.42.5(pid=21689) [trial-2397↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21689)] [trial-2397↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 01:02:10.420803 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:02:10.447983 run osmo-hlr_10.42.42.2(pid=21686): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21686)] 01:02:10.497851 run osmo-hlr_10.42.42.2(pid=21686): stdout: | (launched: 2022-12-14_01:02:07.483416) 01:02:10.549522 run osmo-hlr_10.42.42.2(pid=21686): stderr: | [0;m[1;31m20221214010207674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010207675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010207675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010207675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010207675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010207675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010207691 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010207701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010207701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010207701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:02:10.620752 run osmo-msc_10.42.42.6(pid=21692): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21692)] 01:02:10.669828 run osmo-msc_10.42.42.6(pid=21692): stdout: | (launched: 2022-12-14_01:02:09.490439) 01:02:10.720557 run osmo-msc_10.42.42.6(pid=21692): stderr: | [0;m[38;5;43m20221214010209808 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010209808 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb9f337dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010209808 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010209808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010209809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010209809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010209810 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010209811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010209811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010209811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:02:10.772161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21685): Terminating (SIGTERM) 01:02:10.813313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21688): Terminating (SIGTERM) 01:02:10.855449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21691): Terminating (SIGTERM) 01:02:10.896822 --- ParallelTerminationStrategy: PID 21685 died... 01:02:10.916891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21685): Terminated: ok {rc=0} 01:02:10.962687 --- ParallelTerminationStrategy: PID 21688 died... 01:02:10.982101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21688): Terminated: ok {rc=0} 01:02:11.027539 --- ParallelTerminationStrategy: PID 21691 died... 01:02:11.046977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21691): Terminated: ok {rc=0} 01:02:11.134502 bus /sierra_3: Setting Powered False 01:02:12.229737 bus /sierra_3: Setting Powered False 01:02:13.342522 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 emergency:trx-b200 --------------------------------------------------------------------- 01:02:14.587018 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:02:14.591327 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 01:02:14.623531 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 01:02:14.650933 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 01:02:14.736560 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 01:02:14.769337 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 01:02:14.795982 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 01:02:15.377425 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2397 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 01:02:15.382530 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:15.392941 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 01:02:15.442294 tst emergency_mo_mt_call.py: using LAC 37458 01:02:15.571737 tst emergency_mo_mt_call.py: using RAC 228 01:02:15.691307 tst emergency_mo_mt_call.py: using CellId 37458 01:02:15.816702 tst emergency_mo_mt_call.py: using BVCI 37459 01:02:15.933511 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:15.944698 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:15.956344 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:15.967455 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:15.978892 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:15.990253 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 01:02:16.103812 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 01:02:16.240497 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:02:16.733837 run create_hlr_db(pid=21698): Launched 01:02:16.897058 bus /sierra_2: Setting Powered False 01:02:17.960042 run create_hlr_db(pid=21698): Terminated: ok {rc=0} 01:02:18.407575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21700): Launched 01:02:18.724523 run osmo-hlr_10.42.42.2(pid=21701): Launched 01:02:18.844544 run osmo-stp_10.42.42.5: Starting osmo-stp 01:02:19.394803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21703): Launched 01:02:19.713566 run osmo-stp_10.42.42.5(pid=21704): Launched 01:02:19.844352 tst emergency_mo_mt_call.py: using MSISDN 8424 01:02:20.005708 run osmo-msc_10.42.42.6: Starting osmo-msc 01:02:20.576102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21706): Launched 01:02:20.895173 run osmo-msc_10.42.42.6(pid=21707): Launched 01:02:21.071837 run osmo-stp_10.42.42.5(pid=21704): ERR: Terminated: ERROR {rc=1} [trial-2397↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21704)] 01:02:21.205237 run osmo-stp_10.42.42.5(pid=21704): stdout: | (launched: 2022-12-14_01:02:19.655931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:21.339247 run osmo-stp_10.42.42.5(pid=21704): stderr: | [0;m[38;5;43m20221214010219844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010219844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010219845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010219845 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010219845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010219846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010219846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:21.471605 run osmo-stp_10.42.42.5(pid=21704): stdout: | (launched: 2022-12-14_01:02:19.655931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:21.598372 run osmo-stp_10.42.42.5(pid=21704): stderr: | [0;m[38;5;43m20221214010219844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010219844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010219845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010219845 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010219845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010219846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010219846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:21.749501 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=21704): Process ended prematurely: osmo-stp_10.42.42.5(pid=21704) [trial-2397↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21704)] [trial-2397↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 01:02:21.758600 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 01:02:21.785725 run osmo-hlr_10.42.42.2(pid=21701): ERR: Terminated: ERROR {rc=237} [trial-2397↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21701)] 01:02:21.835666 run osmo-hlr_10.42.42.2(pid=21701): stdout: | (launched: 2022-12-14_01:02:18.667036) 01:02:21.887100 run osmo-hlr_10.42.42.2(pid=21701): stderr: | [0;m[1;31m20221214010218859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010218859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010218859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010218859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010218859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010218859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010218871 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010218881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010218882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010218882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:02:21.959335 run osmo-msc_10.42.42.6(pid=21707): ERR: Terminated: ERROR {rc=2} [trial-2397↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21707)] 01:02:22.008646 run osmo-msc_10.42.42.6(pid=21707): stdout: | (launched: 2022-12-14_01:02:20.837545) 01:02:22.059864 run osmo-msc_10.42.42.6(pid=21707): stderr: | [0;m[38;5;43m20221214010221153 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010221153 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdd88463c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010221153 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010221153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010221153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010221154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010221156 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010221156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010221156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010221156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:02:22.111580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21700): Terminating (SIGTERM) 01:02:22.152808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21703): Terminating (SIGTERM) 01:02:22.194794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21706): Terminating (SIGTERM) 01:02:22.236484 --- ParallelTerminationStrategy: PID 21700 died... 01:02:22.256636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21700): Terminated: ok {rc=0} 01:02:22.302927 --- ParallelTerminationStrategy: PID 21703 died... 01:02:22.322481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21703): Terminated: ok {rc=0} 01:02:22.367889 --- ParallelTerminationStrategy: PID 21706 died... 01:02:22.387404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21706): Terminated: ok {rc=0} 01:02:22.474134 bus /sierra_3: Setting Powered False 01:02:23.571727 bus /sierra_3: Setting Powered False 01:02:24.686912 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 01:02:25.772253 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:25.784341 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 01:02:25.837864 tst emergency_preemptive_call.py: using LAC 37459 01:02:25.955106 tst emergency_preemptive_call.py: using RAC 229 01:02:26.070345 tst emergency_preemptive_call.py: using CellId 37459 01:02:26.187124 tst emergency_preemptive_call.py: using BVCI 37460 01:02:26.294953 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:26.305933 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:26.316478 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:26.326902 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:26.337339 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 01:02:26.347791 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 01:02:26.466515 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 01:02:26.585158 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 01:02:26.701096 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 01:02:26.819715 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:02:27.279117 run create_hlr_db(pid=21709): Launched 01:02:27.399861 bus /sierra_2: Setting Powered False 01:02:28.458267 run create_hlr_db(pid=21709): Terminated: ok {rc=0} 01:02:28.892875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21711): Launched 01:02:29.211661 run osmo-hlr_10.42.42.2(pid=21712): Launched 01:02:29.333397 run osmo-stp_10.42.42.5: Starting osmo-stp 01:02:29.882940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21714): Launched 01:02:30.201261 run osmo-stp_10.42.42.5(pid=21715): Launched 01:02:30.335779 tst emergency_preemptive_call.py: using MSISDN 8425 01:02:30.497053 run osmo-msc_10.42.42.6: Starting osmo-msc 01:02:31.100628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21717): Launched 01:02:31.419091 run osmo-msc_10.42.42.6(pid=21718): Launched 01:02:31.845553 run osmo-stp_10.42.42.5(pid=21715): ERR: Terminated: ERROR {rc=1} [trial-2397↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21715)] 01:02:31.989716 run osmo-stp_10.42.42.5(pid=21715): stdout: | (launched: 2022-12-14_01:02:30.143494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:32.115250 run osmo-stp_10.42.42.5(pid=21715): stderr: | [0;m[38;5;43m20221214010230331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010230331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010230331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010230331 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010230332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010230332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010230332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:32.242272 run osmo-stp_10.42.42.5(pid=21715): stdout: | (launched: 2022-12-14_01:02:30.143494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:32.363535 run osmo-stp_10.42.42.5(pid=21715): stderr: | [0;m[38;5;43m20221214010230331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010230331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010230331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010230331 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010230332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010230332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010230332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:32.505208 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=21715): Process ended prematurely: osmo-stp_10.42.42.5(pid=21715) [trial-2397↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21715)] [trial-2397↪emergency:trx-b200↪emergency_preemptive_call.py:32] 01:02:32.513857 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 01:02:32.540047 run osmo-hlr_10.42.42.2(pid=21712): ERR: Terminated: ERROR {rc=237} [trial-2397↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21712)] 01:02:32.588236 run osmo-hlr_10.42.42.2(pid=21712): stdout: | (launched: 2022-12-14_01:02:29.154176) 01:02:32.637853 run osmo-hlr_10.42.42.2(pid=21712): stderr: | [0;m[1;31m20221214010229344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010229344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010229344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010229344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010229345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010229345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010229357 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010229365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010229365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010229365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:02:32.707289 run osmo-msc_10.42.42.6(pid=21718): ERR: Terminated: ERROR {rc=2} [trial-2397↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21718)] 01:02:32.754801 run osmo-msc_10.42.42.6(pid=21718): stdout: | (launched: 2022-12-14_01:02:31.363338) 01:02:32.803938 run osmo-msc_10.42.42.6(pid=21718): stderr: | [0;m[38;5;43m20221214010231658 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010231659 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6e3d5f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010231659 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010231659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010231659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010231659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010231662 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010231663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010231663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010231663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:02:32.853419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21711): Terminating (SIGTERM) 01:02:32.893098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21714): Terminating (SIGTERM) 01:02:32.932649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21717): Terminating (SIGTERM) 01:02:32.972800 --- ParallelTerminationStrategy: PID 21711 died... 01:02:32.992182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21711): Terminated: ok {rc=0} 01:02:33.036308 --- ParallelTerminationStrategy: PID 21714 died... 01:02:33.055268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21714): Terminated: ok {rc=0} 01:02:33.099215 --- ParallelTerminationStrategy: PID 21717 died... 01:02:33.118107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21717): Terminated: ok {rc=0} 01:02:33.204144 bus /sierra_9: Setting Powered False 01:02:34.303540 bus /sierra_9: Setting Powered False 01:02:35.417173 bus /sierra_8: Setting Powered False 01:02:36.515427 bus /sierra_8: Setting Powered False 01:02:37.632284 bus /sierra_3: Setting Powered False 01:02:38.729529 bus /sierra_3: Setting Powered False 01:02:39.845920 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-b200 --------------------------------------------------------------------- 01:02:41.126826 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:02:41.131555 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 01:02:41.165108 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 01:02:41.205028 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 01:02:41.293940 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 01:02:41.327606 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 01:02:41.366831 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 01:02:41.958718 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 01:02:42.011727 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:42.022824 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 01:02:42.073021 tst cs_paging_gprs_active.py: using LAC 37460 01:02:42.193372 tst cs_paging_gprs_active.py: using RAC 230 01:02:42.312309 tst cs_paging_gprs_active.py: using CellId 37460 01:02:42.431893 tst cs_paging_gprs_active.py: using BVCI 37461 01:02:42.542816 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:42.553630 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:42.564229 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:42.574835 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:42.585963 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:42.596890 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:42.608113 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:42.619110 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:42.630300 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:02:42.750598 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:02:42.867337 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:02:43.070527 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:02:43.373356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21723): Launched 01:02:43.637276 run iperf3-srv_10.42.42.10(pid=21724): Launched 01:02:43.750371 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:02:43.952007 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:02:44.253235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21725): Launched 01:02:44.515557 run iperf3-srv_10.42.42.10(pid=21726): Launched 01:02:44.628422 tst cs_paging_gprs_active.py:38: start network... 01:02:44.829469 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:02:45.294673 run create_hlr_db(pid=21727): Launched 01:02:45.417329 bus /sierra_2: Setting Powered False 01:02:46.494509 run create_hlr_db(pid=21727): Terminated: ok {rc=0} 01:02:46.980403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21729): Launched 01:02:47.317759 run osmo-hlr_10.42.42.2(pid=21730): Launched 01:02:47.443148 run osmo-stp_10.42.42.5: Starting osmo-stp 01:02:48.005255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21732): Launched 01:02:48.327460 run osmo-stp_10.42.42.5(pid=21733): Launched 01:02:48.452441 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:02:49.009858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21735): Launched 01:02:49.136268 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:02:49.410501 run patchelf(pid=21736): Launched 01:02:49.593157 run osmo-stp_10.42.42.5(pid=21733): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21733)] 01:02:49.731542 run osmo-stp_10.42.42.5(pid=21733): stdout: | (launched: 2022-12-14_01:02:48.268776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:49.871479 run osmo-stp_10.42.42.5(pid=21733): stderr: | [0;m[38;5;43m20221214010248456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010248456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010248457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010248457 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010248457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010248458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010248458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:50.011303 run osmo-stp_10.42.42.5(pid=21733): stdout: | (launched: 2022-12-14_01:02:48.268776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:02:50.144475 run osmo-stp_10.42.42.5(pid=21733): stderr: | [0;m[38;5;43m20221214010248456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010248456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010248457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010248457 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010248457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010248458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010248458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:02:50.302655 run patchelf(pid=21736): Terminating (SIGINT) 01:02:50.484555 run patchelf(pid=21736): Terminated: ok {rc=0} 01:02:50.616471 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21733): Process ended prematurely: osmo-stp_10.42.42.5(pid=21733) [trial-2397↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21733)] [trial-2397↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 01:02:50.626754 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 01:02:50.655083 run osmo-hlr_10.42.42.2(pid=21730): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21730)] 01:02:50.705683 run osmo-hlr_10.42.42.2(pid=21730): stdout: | (launched: 2022-12-14_01:02:47.259076) 01:02:50.757292 run osmo-hlr_10.42.42.2(pid=21730): stderr: | [0;m[1;31m20221214010247452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010247452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010247452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010247452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010247452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010247452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010247465 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010247473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010247474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010247474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:02:50.809331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21723): Terminating (SIGTERM) 01:02:50.850606 run iperf3-srv_10.42.42.10(pid=21724): Terminating (SIGTERM) 01:02:50.892241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21725): Terminating (SIGTERM) 01:02:50.934293 run iperf3-srv_10.42.42.10(pid=21726): Terminating (SIGTERM) 01:02:50.975915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21729): Terminating (SIGTERM) 01:02:51.017770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21732): Terminating (SIGTERM) 01:02:51.059688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21735): Terminating (SIGTERM) 01:02:51.102069 --- ParallelTerminationStrategy: PID 21723 died... 01:02:51.122371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21723): Terminated: ok {rc=0} 01:02:51.168684 --- ParallelTerminationStrategy: PID 21724 died... 01:02:51.188590 run iperf3-srv_10.42.42.10(pid=21724): Terminated {rc=256} 01:02:51.234389 --- ParallelTerminationStrategy: PID 21725 died... 01:02:51.253891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21725): Terminated: ok {rc=0} 01:02:51.299438 --- ParallelTerminationStrategy: PID 21726 died... 01:02:51.319209 run iperf3-srv_10.42.42.10(pid=21726): Terminated {rc=256} 01:02:51.364904 --- ParallelTerminationStrategy: PID 21729 died... 01:02:51.384931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21729): Terminated: ok {rc=0} 01:02:51.430667 --- ParallelTerminationStrategy: PID 21732 died... 01:02:51.450441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21732): Terminated: ok {rc=0} 01:02:51.496376 --- ParallelTerminationStrategy: PID 21735 died... 01:02:51.516254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21735): Terminated: ok {rc=0} 01:02:51.604988 bus /gobi_0: Setting Powered False 01:02:52.703855 bus /gobi_0: Setting Powered False 01:02:53.821432 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-b200 iperf3.py ---------------------------------------------- 01:02:54.971505 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:54.983713 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 01:02:55.037628 tst iperf3.py: using LAC 37461 01:02:55.158394 tst iperf3.py: using RAC 231 01:02:55.276130 tst iperf3.py: using CellId 37461 01:02:55.394373 tst iperf3.py: using BVCI 37462 01:02:55.505391 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:55.515911 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:55.526342 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:55.536615 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:55.546841 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:55.557596 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:55.568629 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:55.578998 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:02:55.589438 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:02:55.703948 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:02:55.905353 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:02:56.207376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21737): Launched 01:02:56.469545 run iperf3-srv_10.42.42.10(pid=21738): Launched 01:02:56.582808 tst iperf3.py:8: start network... 01:02:56.784053 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:02:57.248550 run create_hlr_db(pid=21739): Launched 01:02:57.370416 bus /gobi_6: Setting Powered False 01:02:58.429877 run create_hlr_db(pid=21739): Terminated: ok {rc=0} 01:02:58.869239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21741): Launched 01:02:59.192939 run osmo-hlr_10.42.42.2(pid=21742): Launched 01:02:59.316814 run osmo-stp_10.42.42.5: Starting osmo-stp 01:02:59.881759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21744): Launched 01:03:00.205959 run osmo-stp_10.42.42.5(pid=21745): Launched 01:03:00.330921 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:03:00.897796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21747): Launched 01:03:01.048785 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:03:01.329280 run patchelf(pid=21749): Launched 01:03:01.524539 run osmo-stp_10.42.42.5(pid=21745): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21745)] 01:03:01.665636 run osmo-stp_10.42.42.5(pid=21745): stdout: | (launched: 2022-12-14_01:03:00.147314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:01.808433 run osmo-stp_10.42.42.5(pid=21745): stderr: | [0;m[38;5;43m20221214010300333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010300333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010300334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010300334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010300334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010300335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010300335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:01.951241 run osmo-stp_10.42.42.5(pid=21745): stdout: | (launched: 2022-12-14_01:03:00.147314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:02.086853 run osmo-stp_10.42.42.5(pid=21745): stderr: | [0;m[38;5;43m20221214010300333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010300333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010300334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010300334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010300334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010300335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010300335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:02.245586 run patchelf(pid=21749): Terminating (SIGINT) 01:03:02.426884 run patchelf(pid=21749): Terminated: ok {rc=0} 01:03:02.557680 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21745): Process ended prematurely: osmo-stp_10.42.42.5(pid=21745) [trial-2397↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21745)] [trial-2397↪gprs:trx-b200↪iperf3.py:8] 01:03:02.568573 tst iperf3.py:8: Test FAILED (7.6 sec) 01:03:02.597288 run osmo-hlr_10.42.42.2(pid=21742): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21742)] 01:03:02.647957 run osmo-hlr_10.42.42.2(pid=21742): stdout: | (launched: 2022-12-14_01:02:59.134461) 01:03:02.699451 run osmo-hlr_10.42.42.2(pid=21742): stderr: | [0;m[1;31m20221214010259327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010259327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010259327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010259327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010259327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010259327 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010259342 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010259350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010259350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010259350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:03:02.751484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21737): Terminating (SIGTERM) 01:03:02.793049 run iperf3-srv_10.42.42.10(pid=21738): Terminating (SIGTERM) 01:03:02.834773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21741): Terminating (SIGTERM) 01:03:02.876586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21744): Terminating (SIGTERM) 01:03:02.918493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21747): Terminating (SIGTERM) 01:03:02.960615 --- ParallelTerminationStrategy: PID 21737 died... 01:03:02.981012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21737): Terminated: ok {rc=0} 01:03:03.027341 --- ParallelTerminationStrategy: PID 21738 died... 01:03:03.047132 run iperf3-srv_10.42.42.10(pid=21738): Terminated {rc=256} 01:03:03.093230 --- ParallelTerminationStrategy: PID 21741 died... 01:03:03.112831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21741): Terminated: ok {rc=0} 01:03:03.158959 --- ParallelTerminationStrategy: PID 21744 died... 01:03:03.178808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21744): Terminated: ok {rc=0} 01:03:03.224866 --- ParallelTerminationStrategy: PID 21747 died... 01:03:03.245298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21747): Terminated: ok {rc=0} 01:03:03.334305 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 01:03:04.483999 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:04.495895 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 01:03:04.546317 tst iperf3m4.py: using LAC 37462 01:03:04.679430 tst iperf3m4.py: using RAC 232 01:03:04.806356 tst iperf3m4.py: using CellId 37462 01:03:04.934741 tst iperf3m4.py: using BVCI 37463 01:03:05.052536 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:05.063818 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:05.074778 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:05.085799 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:05.097535 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:05.109252 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:05.121278 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:05.133053 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:05.145059 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:03:05.264555 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:03:05.385938 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:03:05.503617 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:03:05.620351 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:03:05.823797 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:06.126303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21750): Launched 01:03:06.391116 run iperf3-srv_10.42.42.10(pid=21751): Launched 01:03:06.504860 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:03:06.706439 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:07.009051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21752): Launched 01:03:07.271809 run iperf3-srv_10.42.42.10(pid=21753): Launched 01:03:07.385076 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:03:07.586595 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:07.890094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21754): Launched 01:03:08.155328 run iperf3-srv_10.42.42.10(pid=21755): Launched 01:03:08.267225 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:03:08.467357 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:08.768516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21756): Launched 01:03:09.030195 run iperf3-srv_10.42.42.10(pid=21757): Launched 01:03:09.144834 tst iperf3m4.py:8: start network... 01:03:09.346048 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:03:09.814094 run create_hlr_db(pid=21758): Launched 01:03:09.940176 bus /gobi_6: Setting Powered False 01:03:11.004549 run create_hlr_db(pid=21758): Terminated: ok {rc=0} 01:03:11.454824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21760): Launched 01:03:11.780254 run osmo-hlr_10.42.42.2(pid=21761): Launched 01:03:11.903320 run osmo-stp_10.42.42.5: Starting osmo-stp 01:03:12.461962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21763): Launched 01:03:12.787226 run osmo-stp_10.42.42.5(pid=21764): Launched 01:03:12.911311 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:03:13.467009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21766): Launched 01:03:13.593379 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:03:13.866108 run patchelf(pid=21767): Launched 01:03:14.047144 run osmo-stp_10.42.42.5(pid=21764): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21764)] 01:03:14.184603 run osmo-stp_10.42.42.5(pid=21764): stdout: | (launched: 2022-12-14_01:03:12.728373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:14.323860 run osmo-stp_10.42.42.5(pid=21764): stderr: | [0;m[38;5;43m20221214010312914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010312914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010312914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010312914 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010312915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010312915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010312915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:14.463887 run osmo-stp_10.42.42.5(pid=21764): stdout: | (launched: 2022-12-14_01:03:12.728373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:14.597161 run osmo-stp_10.42.42.5(pid=21764): stderr: | [0;m[38;5;43m20221214010312914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010312914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010312914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010312914 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010312915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010312915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010312915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:14.754870 run patchelf(pid=21767): Terminating (SIGINT) 01:03:14.936201 run patchelf(pid=21767): Terminated: ok {rc=0} 01:03:15.067466 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21764): Process ended prematurely: osmo-stp_10.42.42.5(pid=21764) [trial-2397↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21764)] [trial-2397↪gprs:trx-b200↪iperf3m4.py:8] 01:03:15.077804 tst iperf3m4.py:8: Test FAILED (10.6 sec) 01:03:15.106520 run osmo-hlr_10.42.42.2(pid=21761): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21761)] 01:03:15.157391 run osmo-hlr_10.42.42.2(pid=21761): stdout: | (launched: 2022-12-14_01:03:11.720827) 01:03:15.209844 run osmo-hlr_10.42.42.2(pid=21761): stderr: | [0;m[1;31m20221214010311913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010311913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010311913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010311913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010311913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010311914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010311925 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010311934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010311934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010311934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:03:15.262091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21750): Terminating (SIGTERM) 01:03:15.303749 run iperf3-srv_10.42.42.10(pid=21751): Terminating (SIGTERM) 01:03:15.346272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21752): Terminating (SIGTERM) 01:03:15.388050 run iperf3-srv_10.42.42.10(pid=21753): Terminating (SIGTERM) 01:03:15.430158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21754): Terminating (SIGTERM) 01:03:15.472121 run iperf3-srv_10.42.42.10(pid=21755): Terminating (SIGTERM) 01:03:15.515248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21756): Terminating (SIGTERM) 01:03:15.557525 run iperf3-srv_10.42.42.10(pid=21757): Terminating (SIGTERM) 01:03:15.599552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21760): Terminating (SIGTERM) 01:03:15.641727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21763): Terminating (SIGTERM) 01:03:15.683533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21766): Terminating (SIGTERM) 01:03:15.725681 --- ParallelTerminationStrategy: PID 21750 died... 01:03:15.745983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21750): Terminated: ok {rc=0} 01:03:15.792494 --- ParallelTerminationStrategy: PID 21751 died... 01:03:15.812448 run iperf3-srv_10.42.42.10(pid=21751): Terminated {rc=256} 01:03:15.861742 --- ParallelTerminationStrategy: PID 21752 died... 01:03:15.882463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21752): Terminated: ok {rc=0} 01:03:15.932791 --- ParallelTerminationStrategy: PID 21753 died... 01:03:15.953076 run iperf3-srv_10.42.42.10(pid=21753): Terminated {rc=256} 01:03:15.999919 --- ParallelTerminationStrategy: PID 21754 died... 01:03:16.020023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21754): Terminated: ok {rc=0} 01:03:16.066946 --- ParallelTerminationStrategy: PID 21755 died... 01:03:16.087365 run iperf3-srv_10.42.42.10(pid=21755): Terminated {rc=256} 01:03:16.134158 --- ParallelTerminationStrategy: PID 21756 died... 01:03:16.154578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21756): Terminated: ok {rc=0} 01:03:16.201495 --- ParallelTerminationStrategy: PID 21757 died... 01:03:16.221908 run iperf3-srv_10.42.42.10(pid=21757): Terminated {rc=256} 01:03:16.268793 --- ParallelTerminationStrategy: PID 21760 died... 01:03:16.289272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21760): Terminated: ok {rc=0} 01:03:16.336169 --- ParallelTerminationStrategy: PID 21763 died... 01:03:16.356739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21763): Terminated: ok {rc=0} 01:03:16.403563 --- ParallelTerminationStrategy: PID 21766 died... 01:03:16.423918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21766): Terminated: ok {rc=0} 01:03:16.519786 bus /gobi_4: Setting Powered False 01:03:17.631575 bus /gobi_4: Setting Powered False 01:03:18.749302 bus /gobi_1: Setting Powered False 01:03:19.847983 bus /gobi_1: Setting Powered False 01:03:20.963437 bus /gobi_0: Setting Powered False 01:03:22.063281 bus /gobi_0: Setting Powered False 01:03:23.178864 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-b200 ping.py ---------------------------------------------- 01:03:24.281518 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:24.292562 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 01:03:24.341744 tst ping.py: using LAC 37463 01:03:24.468426 tst ping.py: using RAC 233 01:03:24.593054 tst ping.py: using CellId 37463 01:03:24.719447 tst ping.py: using BVCI 37464 01:03:24.835157 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:24.846502 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:24.857664 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:24.868455 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:24.879532 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:24.890688 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:24.901989 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:24.913226 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:03:25.027099 tst ping.py:19: start network... 01:03:25.224942 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:03:25.682356 run create_hlr_db(pid=21768): Launched 01:03:25.802831 bus /gobi_6: Setting Powered False 01:03:26.862056 run create_hlr_db(pid=21768): Terminated: ok {rc=0} 01:03:27.295133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21770): Launched 01:03:27.614802 run osmo-hlr_10.42.42.2(pid=21771): Launched 01:03:27.740019 run osmo-stp_10.42.42.5: Starting osmo-stp 01:03:28.291488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21773): Launched 01:03:28.610855 run osmo-stp_10.42.42.5(pid=21774): Launched 01:03:28.733852 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:03:29.279538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21776): Launched 01:03:29.401596 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:03:29.669451 run patchelf(pid=21777): Launched 01:03:29.850078 run osmo-stp_10.42.42.5(pid=21774): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21774)] 01:03:29.985876 run osmo-stp_10.42.42.5(pid=21774): stdout: | (launched: 2022-12-14_01:03:28.552488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:30.122760 run osmo-stp_10.42.42.5(pid=21774): stderr: | [0;m[38;5;43m20221214010328741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010328741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010328741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010328742 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010328742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010328742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010328742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:30.260015 run osmo-stp_10.42.42.5(pid=21774): stdout: | (launched: 2022-12-14_01:03:28.552488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:30.391041 run osmo-stp_10.42.42.5(pid=21774): stderr: | [0;m[38;5;43m20221214010328741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010328741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010328741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010328742 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010328742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010328742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010328742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:30.546488 run patchelf(pid=21777): Terminating (SIGINT) 01:03:30.725735 run patchelf(pid=21777): Terminated: ok {rc=0} 01:03:30.872546 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21774): Process ended prematurely: osmo-stp_10.42.42.5(pid=21774) [trial-2397↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21774)] [trial-2397↪gprs:trx-b200↪ping.py:22] 01:03:30.888701 tst ping.py:22: Test FAILED (6.6 sec) 01:03:30.916795 run osmo-hlr_10.42.42.2(pid=21771): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21771)] 01:03:30.971090 run osmo-hlr_10.42.42.2(pid=21771): stdout: | (launched: 2022-12-14_01:03:27.556556) 01:03:31.032940 run osmo-hlr_10.42.42.2(pid=21771): stderr: | [0;m[1;31m20221214010327748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010327748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010327748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010327748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010327748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010327748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010327761 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010327770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010327770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010327770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:03:31.090718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21770): Terminating (SIGTERM) 01:03:31.133474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21773): Terminating (SIGTERM) 01:03:31.178027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21776): Terminating (SIGTERM) 01:03:31.222749 --- ParallelTerminationStrategy: PID 21770 died... 01:03:31.244554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21770): Terminated: ok {rc=0} 01:03:31.292841 --- ParallelTerminationStrategy: PID 21773 died... 01:03:31.314439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21773): Terminated: ok {rc=0} 01:03:31.362575 --- ParallelTerminationStrategy: PID 21776 died... 01:03:31.384136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21776): Terminated: ok {rc=0} 01:03:31.480311 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 01:03:32.576751 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:32.588032 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 01:03:32.637692 tst ping_idle_ping.py: using LAC 37464 01:03:32.768082 tst ping_idle_ping.py: using RAC 234 01:03:32.891400 tst ping_idle_ping.py: using CellId 37464 01:03:33.015816 tst ping_idle_ping.py: using BVCI 37465 01:03:33.131949 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:33.143286 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:33.154578 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:33.165531 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:33.176648 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:33.187807 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:33.199059 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:03:33.210261 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:03:33.325254 tst ping_idle_ping.py:24: start network... 01:03:33.522879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:03:33.984097 run create_hlr_db(pid=21778): Launched 01:03:34.105643 bus /gobi_6: Setting Powered False 01:03:35.165604 run create_hlr_db(pid=21778): Terminated: ok {rc=0} 01:03:35.579345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21780): Launched 01:03:35.873979 run osmo-hlr_10.42.42.2(pid=21781): Launched 01:03:35.986398 run osmo-stp_10.42.42.5: Starting osmo-stp 01:03:36.491566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21783): Launched 01:03:36.787014 run osmo-stp_10.42.42.5(pid=21784): Launched 01:03:36.898518 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:03:37.406287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21786): Launched 01:03:37.519290 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:03:37.768367 run patchelf(pid=21787): Launched 01:03:37.933345 run osmo-stp_10.42.42.5(pid=21784): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21784)] 01:03:38.059000 run osmo-stp_10.42.42.5(pid=21784): stdout: | (launched: 2022-12-14_01:03:36.732522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:38.186069 run osmo-stp_10.42.42.5(pid=21784): stderr: | [0;m[38;5;43m20221214010336897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010336897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010336897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010336898 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010336898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010336898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010336898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:38.313290 run osmo-stp_10.42.42.5(pid=21784): stdout: | (launched: 2022-12-14_01:03:36.732522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:38.433979 run osmo-stp_10.42.42.5(pid=21784): stderr: | [0;m[38;5;43m20221214010336897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010336897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010336897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010336898 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010336898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010336898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010336898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:38.577145 run patchelf(pid=21787): Terminating (SIGINT) 01:03:38.742650 run patchelf(pid=21787): Terminated: ok {rc=0} 01:03:38.862026 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21784): Process ended prematurely: osmo-stp_10.42.42.5(pid=21784) [trial-2397↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21784)] [trial-2397↪gprs:trx-b200↪ping_idle_ping.py:27] 01:03:38.870810 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 01:03:38.897407 run osmo-hlr_10.42.42.2(pid=21781): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21781)] 01:03:38.944820 run osmo-hlr_10.42.42.2(pid=21781): stdout: | (launched: 2022-12-14_01:03:35.819830) 01:03:38.993774 run osmo-hlr_10.42.42.2(pid=21781): stderr: | [0;m[1;31m20221214010335991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010335991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010335991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010335992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010335992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010335992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010336003 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010336011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010336012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010336012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:03:39.043271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21780): Terminating (SIGTERM) 01:03:39.082803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21783): Terminating (SIGTERM) 01:03:39.122271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21786): Terminating (SIGTERM) 01:03:39.161915 --- ParallelTerminationStrategy: PID 21780 died... 01:03:39.181070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21780): Terminated: ok {rc=0} 01:03:39.224777 --- ParallelTerminationStrategy: PID 21783 died... 01:03:39.243378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21783): Terminated: ok {rc=0} 01:03:39.286642 --- ParallelTerminationStrategy: PID 21786 died... 01:03:39.305082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21786): Terminated: ok {rc=0} 01:03:39.389717 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 01:03:40.700271 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:03:40.706277 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:03:40.740871 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:03:40.781142 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:03:40.870261 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:03:40.904098 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:03:40.943655 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:03:41.537934 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:03:41.591334 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:41.602826 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:03:41.654686 tst cs_paging_gprs_active.py: using LAC 37465 01:03:41.781411 tst cs_paging_gprs_active.py: using RAC 235 01:03:41.909229 tst cs_paging_gprs_active.py: using CellId 37465 01:03:42.035639 tst cs_paging_gprs_active.py: using BVCI 37466 01:03:42.155028 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:42.166341 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:42.177509 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:42.188455 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:42.200148 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:42.211776 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:42.223585 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:42.235214 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:42.247115 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:03:42.364311 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:03:42.484158 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:03:42.704756 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:43.029760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21791): Launched 01:03:43.313396 run iperf3-srv_10.42.42.10(pid=21792): Launched 01:03:43.437039 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:03:43.656666 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:43.981944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21793): Launched 01:03:44.264876 run iperf3-srv_10.42.42.10(pid=21794): Launched 01:03:44.388302 tst cs_paging_gprs_active.py:38: start network... 01:03:44.607650 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:03:45.108517 run create_hlr_db(pid=21795): Launched 01:03:45.232207 bus /gobi_6: Setting Powered False 01:03:46.301328 run create_hlr_db(pid=21795): Terminated: ok {rc=0} 01:03:46.763982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21797): Launched 01:03:47.084435 run osmo-hlr_10.42.42.2(pid=21798): Launched 01:03:47.274777 run osmo-stp_10.42.42.5: Starting osmo-stp 01:03:47.832654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21800): Launched 01:03:48.156485 run osmo-stp_10.42.42.5(pid=21801): Launched 01:03:48.279440 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:03:48.838367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21803): Launched 01:03:48.962858 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:03:49.237219 run patchelf(pid=21804): Launched 01:03:49.417685 run osmo-stp_10.42.42.5(pid=21801): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21801)] 01:03:49.555339 run osmo-stp_10.42.42.5(pid=21801): stdout: | (launched: 2022-12-14_01:03:48.097467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:49.695395 run osmo-stp_10.42.42.5(pid=21801): stderr: | [0;m[38;5;43m20221214010348285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010348285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010348285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010348286 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010348286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010348286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010348286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:49.834821 run osmo-stp_10.42.42.5(pid=21801): stdout: | (launched: 2022-12-14_01:03:48.097467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:03:49.967476 run osmo-stp_10.42.42.5(pid=21801): stderr: | [0;m[38;5;43m20221214010348285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010348285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010348285 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010348286 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010348286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010348286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010348286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:03:50.125824 run patchelf(pid=21804): Terminating (SIGINT) 01:03:50.308224 run patchelf(pid=21804): Terminated: ok {rc=0} 01:03:50.440013 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21801): Process ended prematurely: osmo-stp_10.42.42.5(pid=21801) [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21801)] [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:03:50.450325 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 01:03:50.478557 run osmo-hlr_10.42.42.2(pid=21798): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21798)] 01:03:50.528676 run osmo-hlr_10.42.42.2(pid=21798): stdout: | (launched: 2022-12-14_01:03:47.027935) 01:03:50.580420 run osmo-hlr_10.42.42.2(pid=21798): stderr: | [0;m[1;31m20221214010347286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010347286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010347286 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010347287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010347287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010347287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010347303 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010347313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010347313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010347313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:03:50.632307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21791): Terminating (SIGTERM) 01:03:50.673976 run iperf3-srv_10.42.42.10(pid=21792): Terminating (SIGTERM) 01:03:50.715513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21793): Terminating (SIGTERM) 01:03:50.757257 run iperf3-srv_10.42.42.10(pid=21794): Terminating (SIGTERM) 01:03:50.798736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21797): Terminating (SIGTERM) 01:03:50.840505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21800): Terminating (SIGTERM) 01:03:50.882511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21803): Terminating (SIGTERM) 01:03:50.924395 --- ParallelTerminationStrategy: PID 21791 died... 01:03:50.944755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21791): Terminated: ok {rc=0} 01:03:50.990477 --- ParallelTerminationStrategy: PID 21792 died... 01:03:51.010043 run iperf3-srv_10.42.42.10(pid=21792): Terminated {rc=256} 01:03:51.055429 --- ParallelTerminationStrategy: PID 21793 died... 01:03:51.075032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21793): Terminated: ok {rc=0} 01:03:51.120536 --- ParallelTerminationStrategy: PID 21794 died... 01:03:51.140039 run iperf3-srv_10.42.42.10(pid=21794): Terminated {rc=256} 01:03:51.185189 --- ParallelTerminationStrategy: PID 21797 died... 01:03:51.204658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21797): Terminated: ok {rc=0} 01:03:51.250333 --- ParallelTerminationStrategy: PID 21800 died... 01:03:51.269943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21800): Terminated: ok {rc=0} 01:03:51.315415 --- ParallelTerminationStrategy: PID 21803 died... 01:03:51.335027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21803): Terminated: ok {rc=0} 01:03:51.421896 bus /gobi_0: Setting Powered False 01:03:52.519208 bus /gobi_0: Setting Powered False 01:03:53.633657 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:03:54.781614 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:54.793501 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:03:54.847878 tst iperf3.py: using LAC 37466 01:03:54.975690 tst iperf3.py: using RAC 236 01:03:55.102477 tst iperf3.py: using CellId 37466 01:03:55.230907 tst iperf3.py: using BVCI 37467 01:03:55.349748 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:55.361132 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:55.372189 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:55.383321 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:55.394718 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:55.406172 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:55.417772 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:55.429055 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:03:55.440557 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:03:55.559915 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:03:55.778583 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:03:56.102389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21805): Launched 01:03:56.385722 run iperf3-srv_10.42.42.10(pid=21806): Launched 01:03:56.506888 tst iperf3.py:8: start network... 01:03:56.725516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:03:57.225187 run create_hlr_db(pid=21807): Launched 01:03:57.347880 bus /gobi_6: Setting Powered False 01:03:58.411093 run create_hlr_db(pid=21807): Terminated: ok {rc=0} 01:03:58.861224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21809): Launched 01:03:59.184525 run osmo-hlr_10.42.42.2(pid=21810): Launched 01:03:59.307490 run osmo-stp_10.42.42.5: Starting osmo-stp 01:03:59.866288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21812): Launched 01:04:00.189750 run osmo-stp_10.42.42.5(pid=21813): Launched 01:04:00.312122 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:04:00.882273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21815): Launched 01:04:01.023974 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:04:01.286014 run patchelf(pid=21816): Launched 01:04:01.472511 run osmo-stp_10.42.42.5(pid=21813): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21813)] 01:04:01.604494 run osmo-stp_10.42.42.5(pid=21813): stdout: | (launched: 2022-12-14_01:04:00.130788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:01.739916 run osmo-stp_10.42.42.5(pid=21813): stderr: | [0;m[38;5;43m20221214010400316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010400317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010400317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010400317 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010400318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010400318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010400318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:01.872665 run osmo-stp_10.42.42.5(pid=21813): stdout: | (launched: 2022-12-14_01:04:00.130788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:02.000667 run osmo-stp_10.42.42.5(pid=21813): stderr: | [0;m[38;5;43m20221214010400316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010400317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010400317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010400317 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010400318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010400318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010400318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:02.151835 run patchelf(pid=21816): Terminating (SIGINT) 01:04:02.321926 run patchelf(pid=21816): Terminated: ok {rc=0} 01:04:02.443895 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21813): Process ended prematurely: osmo-stp_10.42.42.5(pid=21813) [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21813)] [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 01:04:02.453972 tst iperf3.py:8: Test FAILED (7.7 sec) 01:04:02.480643 run osmo-hlr_10.42.42.2(pid=21810): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21810)] 01:04:02.527803 run osmo-hlr_10.42.42.2(pid=21810): stdout: | (launched: 2022-12-14_01:03:59.125612) 01:04:02.576339 run osmo-hlr_10.42.42.2(pid=21810): stderr: | [0;m[1;31m20221214010359317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010359317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010359317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010359317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010359317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010359317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010359329 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010359339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010359339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010359339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:04:02.625744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21805): Terminating (SIGTERM) 01:04:02.664745 run iperf3-srv_10.42.42.10(pid=21806): Terminating (SIGTERM) 01:04:02.703670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21809): Terminating (SIGTERM) 01:04:02.742656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21812): Terminating (SIGTERM) 01:04:02.781695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21815): Terminating (SIGTERM) 01:04:02.820932 --- ParallelTerminationStrategy: PID 21805 died... 01:04:02.839923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21805): Terminated: ok {rc=0} 01:04:02.883059 --- ParallelTerminationStrategy: PID 21806 died... 01:04:02.901414 run iperf3-srv_10.42.42.10(pid=21806): Terminated {rc=256} 01:04:02.944365 --- ParallelTerminationStrategy: PID 21809 died... 01:04:02.962905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21809): Terminated: ok {rc=0} 01:04:03.005857 --- ParallelTerminationStrategy: PID 21812 died... 01:04:03.024238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21812): Terminated: ok {rc=0} 01:04:03.067555 --- ParallelTerminationStrategy: PID 21815 died... 01:04:03.086161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21815): Terminated: ok {rc=0} 01:04:03.171016 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:04:04.315600 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:04.330407 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:04:04.383755 tst iperf3m4.py: using LAC 37467 01:04:04.501424 tst iperf3m4.py: using RAC 237 01:04:04.620630 tst iperf3m4.py: using CellId 37467 01:04:04.748595 tst iperf3m4.py: using BVCI 37468 01:04:04.866248 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:04.877663 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:04.888800 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:04.899953 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:04.911261 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:04.922749 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:04.934366 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:04.945812 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:04.957416 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:04:05.073279 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:04:05.195476 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:04:05.311616 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:04:05.427003 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:04:05.629209 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:05.932739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21817): Launched 01:04:06.196353 run iperf3-srv_10.42.42.10(pid=21818): Launched 01:04:06.309518 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:04:06.510299 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:06.812821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21819): Launched 01:04:07.075568 run iperf3-srv_10.42.42.10(pid=21820): Launched 01:04:07.188274 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:04:07.388454 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:07.690820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21821): Launched 01:04:07.953214 run iperf3-srv_10.42.42.10(pid=21822): Launched 01:04:08.065498 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:04:08.266247 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:08.567919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21823): Launched 01:04:08.830623 run iperf3-srv_10.42.42.10(pid=21824): Launched 01:04:08.942525 tst iperf3m4.py:8: start network... 01:04:09.142406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:04:09.608612 run create_hlr_db(pid=21825): Launched 01:04:09.734835 bus /gobi_6: Setting Powered False 01:04:10.798502 run create_hlr_db(pid=21825): Terminated: ok {rc=0} 01:04:11.249771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21827): Launched 01:04:11.574050 run osmo-hlr_10.42.42.2(pid=21828): Launched 01:04:11.699785 run osmo-stp_10.42.42.5: Starting osmo-stp 01:04:12.259831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21830): Launched 01:04:12.583576 run osmo-stp_10.42.42.5(pid=21831): Launched 01:04:12.707233 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:04:13.264606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21833): Launched 01:04:13.389770 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:04:13.664580 run patchelf(pid=21834): Launched 01:04:13.845766 run osmo-stp_10.42.42.5(pid=21831): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21831)] 01:04:13.983867 run osmo-stp_10.42.42.5(pid=21831): stdout: | (launched: 2022-12-14_01:04:12.524191) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:14.123997 run osmo-stp_10.42.42.5(pid=21831): stderr: | [0;m[38;5;43m20221214010412711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010412711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010412712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010412712 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010412713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010412713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010412713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:14.264322 run osmo-stp_10.42.42.5(pid=21831): stdout: | (launched: 2022-12-14_01:04:12.524191) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:14.397846 run osmo-stp_10.42.42.5(pid=21831): stderr: | [0;m[38;5;43m20221214010412711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010412711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010412712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010412712 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010412713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010412713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010412713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:14.556060 run patchelf(pid=21834): Terminating (SIGINT) 01:04:14.738792 run patchelf(pid=21834): Terminated: ok {rc=0} 01:04:14.870211 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21831): Process ended prematurely: osmo-stp_10.42.42.5(pid=21831) [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21831)] [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 01:04:14.880383 tst iperf3m4.py:8: Test FAILED (10.6 sec) 01:04:14.909059 run osmo-hlr_10.42.42.2(pid=21828): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21828)] 01:04:14.959522 run osmo-hlr_10.42.42.2(pid=21828): stdout: | (launched: 2022-12-14_01:04:11.515186) 01:04:15.011392 run osmo-hlr_10.42.42.2(pid=21828): stderr: | [0;m[1;31m20221214010411709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010411709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010411709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010411709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010411709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010411709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010411722 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010411730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010411730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010411730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:04:15.063196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21817): Terminating (SIGTERM) 01:04:15.105217 run iperf3-srv_10.42.42.10(pid=21818): Terminating (SIGTERM) 01:04:15.147613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21819): Terminating (SIGTERM) 01:04:15.189965 run iperf3-srv_10.42.42.10(pid=21820): Terminating (SIGTERM) 01:04:15.231886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21821): Terminating (SIGTERM) 01:04:15.274120 run iperf3-srv_10.42.42.10(pid=21822): Terminating (SIGTERM) 01:04:15.316144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21823): Terminating (SIGTERM) 01:04:15.358126 run iperf3-srv_10.42.42.10(pid=21824): Terminating (SIGTERM) 01:04:15.399958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21827): Terminating (SIGTERM) 01:04:15.442050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21830): Terminating (SIGTERM) 01:04:15.483813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21833): Terminating (SIGTERM) 01:04:15.526123 --- ParallelTerminationStrategy: PID 21817 died... 01:04:15.546495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21817): Terminated: ok {rc=0} 01:04:15.592788 --- ParallelTerminationStrategy: PID 21818 died... 01:04:15.613079 run iperf3-srv_10.42.42.10(pid=21818): Terminated {rc=256} 01:04:15.659339 --- ParallelTerminationStrategy: PID 21819 died... 01:04:15.679228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21819): Terminated: ok {rc=0} 01:04:15.725393 --- ParallelTerminationStrategy: PID 21820 died... 01:04:15.745363 run iperf3-srv_10.42.42.10(pid=21820): Terminated {rc=256} 01:04:15.791428 --- ParallelTerminationStrategy: PID 21821 died... 01:04:15.811290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21821): Terminated: ok {rc=0} 01:04:15.867081 --- ParallelTerminationStrategy: PID 21822 died... 01:04:15.888620 run iperf3-srv_10.42.42.10(pid=21822): Terminated {rc=256} 01:04:15.946663 --- ParallelTerminationStrategy: PID 21823 died... 01:04:15.966498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21823): Terminated: ok {rc=0} 01:04:16.013339 --- ParallelTerminationStrategy: PID 21824 died... 01:04:16.038505 run iperf3-srv_10.42.42.10(pid=21824): Terminated {rc=256} 01:04:16.084662 --- ParallelTerminationStrategy: PID 21827 died... 01:04:16.105753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21827): Terminated: ok {rc=0} 01:04:16.153525 --- ParallelTerminationStrategy: PID 21830 died... 01:04:16.174636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21830): Terminated: ok {rc=0} 01:04:16.221602 --- ParallelTerminationStrategy: PID 21833 died... 01:04:16.242628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21833): Terminated: ok {rc=0} 01:04:16.332670 bus /gobi_4: Setting Powered False 01:04:17.428155 bus /gobi_4: Setting Powered False 01:04:18.543910 bus /gobi_1: Setting Powered False 01:04:19.642992 bus /gobi_1: Setting Powered False 01:04:20.757399 bus /gobi_0: Setting Powered False 01:04:21.854770 bus /gobi_0: Setting Powered False 01:04:22.973830 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 01:04:24.077245 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:24.089188 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:04:24.140784 tst ping.py: using LAC 37468 01:04:24.257246 tst ping.py: using RAC 238 01:04:24.374224 tst ping.py: using CellId 37468 01:04:24.491253 tst ping.py: using BVCI 37469 01:04:24.600152 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:24.611004 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:24.621666 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:24.632259 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:24.642772 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:24.653353 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:24.664048 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:24.674592 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:04:24.787923 tst ping.py:19: start network... 01:04:24.984859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:04:25.441190 run create_hlr_db(pid=21835): Launched 01:04:25.563005 bus /gobi_6: Setting Powered False 01:04:26.622832 run create_hlr_db(pid=21835): Terminated: ok {rc=0} 01:04:27.059750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21837): Launched 01:04:27.379323 run osmo-hlr_10.42.42.2(pid=21838): Launched 01:04:27.503440 run osmo-stp_10.42.42.5: Starting osmo-stp 01:04:28.057951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21840): Launched 01:04:28.378721 run osmo-stp_10.42.42.5(pid=21841): Launched 01:04:28.502033 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:04:29.054019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21843): Launched 01:04:29.178984 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:04:29.449892 run patchelf(pid=21844): Launched 01:04:29.629154 run osmo-stp_10.42.42.5(pid=21841): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21841)] 01:04:29.763998 run osmo-stp_10.42.42.5(pid=21841): stdout: | (launched: 2022-12-14_01:04:28.320316) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:29.900812 run osmo-stp_10.42.42.5(pid=21841): stderr: | [0;m[38;5;43m20221214010428506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010428506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010428506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010428506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010428507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010428507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010428507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:30.037716 run osmo-stp_10.42.42.5(pid=21841): stdout: | (launched: 2022-12-14_01:04:28.320316) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:30.168526 run osmo-stp_10.42.42.5(pid=21841): stderr: | [0;m[38;5;43m20221214010428506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010428506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010428506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010428506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010428507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010428507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010428507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:30.323732 run patchelf(pid=21844): Terminating (SIGINT) 01:04:30.501893 run patchelf(pid=21844): Terminated: ok {rc=0} 01:04:30.630831 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21841): Process ended prematurely: osmo-stp_10.42.42.5(pid=21841) [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21841)] [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 01:04:30.640389 tst ping.py:22: Test FAILED (6.6 sec) 01:04:30.668373 run osmo-hlr_10.42.42.2(pid=21838): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21838)] 01:04:30.718701 run osmo-hlr_10.42.42.2(pid=21838): stdout: | (launched: 2022-12-14_01:04:27.320789) 01:04:30.770898 run osmo-hlr_10.42.42.2(pid=21838): stderr: | [0;m[1;31m20221214010427512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010427512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010427512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010427512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010427512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010427512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010427525 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010427535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010427535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010427535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:04:30.823468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21837): Terminating (SIGTERM) 01:04:30.883967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21840): Terminating (SIGTERM) 01:04:30.933413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21843): Terminating (SIGTERM) 01:04:30.978377 --- ParallelTerminationStrategy: PID 21837 died... 01:04:31.000392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21837): Terminated: ok {rc=0} 01:04:31.054125 --- ParallelTerminationStrategy: PID 21840 died... 01:04:31.075181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21840): Terminated: ok {rc=0} 01:04:31.124256 --- ParallelTerminationStrategy: PID 21843 died... 01:04:31.146002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21843): Terminated: ok {rc=0} 01:04:31.238902 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:04:32.327163 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:32.338653 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:04:32.389754 tst ping_idle_ping.py: using LAC 37469 01:04:32.518442 tst ping_idle_ping.py: using RAC 239 01:04:32.646141 tst ping_idle_ping.py: using CellId 37469 01:04:32.770902 tst ping_idle_ping.py: using BVCI 37470 01:04:32.886933 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:32.898564 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:32.909864 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:32.920843 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:32.932326 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:32.943705 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:32.955258 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:04:32.966735 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:04:33.085658 tst ping_idle_ping.py:24: start network... 01:04:33.301587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:04:33.799148 run create_hlr_db(pid=21845): Launched 01:04:33.920492 bus /gobi_6: Setting Powered False 01:04:34.984031 run create_hlr_db(pid=21845): Terminated: ok {rc=0} 01:04:35.430920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21847): Launched 01:04:35.761040 run osmo-hlr_10.42.42.2(pid=21848): Launched 01:04:35.883018 run osmo-stp_10.42.42.5: Starting osmo-stp 01:04:36.432890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21850): Launched 01:04:36.755602 run osmo-stp_10.42.42.5(pid=21851): Launched 01:04:36.879331 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:04:37.430673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21853): Launched 01:04:37.555563 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:04:37.827086 run patchelf(pid=21854): Launched 01:04:38.007326 run osmo-stp_10.42.42.5(pid=21851): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21851)] 01:04:38.143204 run osmo-stp_10.42.42.5(pid=21851): stdout: | (launched: 2022-12-14_01:04:36.696750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:38.280817 run osmo-stp_10.42.42.5(pid=21851): stderr: | [0;m[38;5;43m20221214010436882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010436882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010436883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010436883 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010436884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010436884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010436884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:38.418610 run osmo-stp_10.42.42.5(pid=21851): stdout: | (launched: 2022-12-14_01:04:36.696750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:38.549896 run osmo-stp_10.42.42.5(pid=21851): stderr: | [0;m[38;5;43m20221214010436882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010436882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010436883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010436883 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010436884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010436884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010436884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:38.706064 run patchelf(pid=21854): Terminating (SIGINT) 01:04:38.886135 run patchelf(pid=21854): Terminated: ok {rc=0} 01:04:39.015934 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21851): Process ended prematurely: osmo-stp_10.42.42.5(pid=21851) [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21851)] [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 01:04:39.025796 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:04:39.054303 run osmo-hlr_10.42.42.2(pid=21848): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21848)] 01:04:39.105264 run osmo-hlr_10.42.42.2(pid=21848): stdout: | (launched: 2022-12-14_01:04:35.702129) 01:04:39.158063 run osmo-hlr_10.42.42.2(pid=21848): stderr: | [0;m[1;31m20221214010435894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010435894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010435894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010435894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010435894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010435894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010435907 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010435915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010435916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010435916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:04:39.211151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21847): Terminating (SIGTERM) 01:04:39.253349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21850): Terminating (SIGTERM) 01:04:39.295772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21853): Terminating (SIGTERM) 01:04:39.338899 --- ParallelTerminationStrategy: PID 21847 died... 01:04:39.359543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21847): Terminated: ok {rc=0} 01:04:39.406245 --- ParallelTerminationStrategy: PID 21850 died... 01:04:39.426306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21850): Terminated: ok {rc=0} 01:04:39.472400 --- ParallelTerminationStrategy: PID 21853 died... 01:04:39.492492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21853): Terminated: ok {rc=0} 01:04:39.581557 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:04:40.897606 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:04:40.904086 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:04:40.938251 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:04:40.979924 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:04:41.070073 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:04:41.103682 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:04:41.143672 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:04:41.739692 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:04:41.793549 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:41.804820 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:04:41.877631 tst cs_paging_gprs_active.py: using LAC 37470 01:04:41.998426 tst cs_paging_gprs_active.py: using RAC 240 01:04:42.119776 tst cs_paging_gprs_active.py: using CellId 37470 01:04:42.240896 tst cs_paging_gprs_active.py: using BVCI 37471 01:04:42.351857 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:42.362699 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:42.373292 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:42.383796 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:42.394347 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:42.405017 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:42.415629 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:42.426094 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:42.436740 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:04:42.557121 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:04:42.678806 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:04:42.898351 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:43.224785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21859): Launched 01:04:43.508529 run iperf3-srv_10.42.42.10(pid=21860): Launched 01:04:43.630990 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:04:43.850512 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:44.176783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21861): Launched 01:04:44.459267 run iperf3-srv_10.42.42.10(pid=21862): Launched 01:04:44.583035 tst cs_paging_gprs_active.py:38: start network... 01:04:44.803109 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:04:45.305798 run create_hlr_db(pid=21863): Launched 01:04:45.433082 bus /gobi_6: Setting Powered False 01:04:46.506180 run create_hlr_db(pid=21863): Terminated: ok {rc=0} 01:04:47.033852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21865): Launched 01:04:47.351003 run osmo-hlr_10.42.42.2(pid=21866): Launched 01:04:47.467091 run osmo-stp_10.42.42.5: Starting osmo-stp 01:04:47.991970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21868): Launched 01:04:48.295727 run osmo-stp_10.42.42.5(pid=21869): Launched 01:04:48.411307 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:04:48.934342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21871): Launched 01:04:49.052716 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:04:49.308716 run patchelf(pid=21872): Launched 01:04:49.478077 run osmo-stp_10.42.42.5(pid=21869): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21869)] 01:04:49.606840 run osmo-stp_10.42.42.5(pid=21869): stdout: | (launched: 2022-12-14_01:04:48.239977) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:49.737403 run osmo-stp_10.42.42.5(pid=21869): stderr: | [0;m[38;5;43m20221214010448407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010448407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010448408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010448408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010448409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010448409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010448409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:49.867612 run osmo-stp_10.42.42.5(pid=21869): stdout: | (launched: 2022-12-14_01:04:48.239977) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:04:49.992084 run osmo-stp_10.42.42.5(pid=21869): stderr: | [0;m[38;5;43m20221214010448407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010448407 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010448408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010448408 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010448409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010448409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010448409 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:04:50.139285 run patchelf(pid=21872): Terminating (SIGINT) 01:04:50.309281 run patchelf(pid=21872): Terminated: ok {rc=0} 01:04:50.431405 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21869): Process ended prematurely: osmo-stp_10.42.42.5(pid=21869) [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21869)] [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:04:50.440864 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 01:04:50.467707 run osmo-hlr_10.42.42.2(pid=21866): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21866)] 01:04:50.515310 run osmo-hlr_10.42.42.2(pid=21866): stdout: | (launched: 2022-12-14_01:04:47.295521) 01:04:50.564865 run osmo-hlr_10.42.42.2(pid=21866): stderr: | [0;m[1;31m20221214010447468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010447468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010447468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010447468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010447468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010447468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010447481 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010447490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010447491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010447491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:04:50.614240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21859): Terminating (SIGTERM) 01:04:50.653898 run iperf3-srv_10.42.42.10(pid=21860): Terminating (SIGTERM) 01:04:50.693191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21861): Terminating (SIGTERM) 01:04:50.732387 run iperf3-srv_10.42.42.10(pid=21862): Terminating (SIGTERM) 01:04:50.771402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21865): Terminating (SIGTERM) 01:04:50.810501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21868): Terminating (SIGTERM) 01:04:50.849640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21871): Terminating (SIGTERM) 01:04:50.888892 --- ParallelTerminationStrategy: PID 21859 died... 01:04:50.907826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21859): Terminated: ok {rc=0} 01:04:50.951287 --- ParallelTerminationStrategy: PID 21860 died... 01:04:50.969604 run iperf3-srv_10.42.42.10(pid=21860): Terminated {rc=256} 01:04:51.012608 --- ParallelTerminationStrategy: PID 21861 died... 01:04:51.031128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21861): Terminated: ok {rc=0} 01:04:51.074143 --- ParallelTerminationStrategy: PID 21862 died... 01:04:51.092350 run iperf3-srv_10.42.42.10(pid=21862): Terminated {rc=256} 01:04:51.135303 --- ParallelTerminationStrategy: PID 21865 died... 01:04:51.153566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21865): Terminated: ok {rc=0} 01:04:51.196406 --- ParallelTerminationStrategy: PID 21868 died... 01:04:51.214709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21868): Terminated: ok {rc=0} 01:04:51.257651 --- ParallelTerminationStrategy: PID 21871 died... 01:04:51.275960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21871): Terminated: ok {rc=0} 01:04:51.360234 bus /gobi_0: Setting Powered False 01:04:52.460156 bus /gobi_0: Setting Powered False 01:04:53.578505 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:04:54.723672 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:54.735228 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:04:54.806850 tst iperf3.py: using LAC 37471 01:04:54.934075 tst iperf3.py: using RAC 241 01:04:55.062852 tst iperf3.py: using CellId 37471 01:04:55.190962 tst iperf3.py: using BVCI 37472 01:04:55.310615 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:55.322043 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:55.333165 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:55.344303 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:55.355637 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:55.367024 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:55.378577 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:55.389942 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:04:55.401477 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:04:55.515130 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:04:55.718331 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:04:56.022446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21873): Launched 01:04:56.286654 run iperf3-srv_10.42.42.10(pid=21874): Launched 01:04:56.399926 tst iperf3.py:8: start network... 01:04:56.602685 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:04:57.071390 run create_hlr_db(pid=21875): Launched 01:04:57.195745 bus /gobi_6: Setting Powered False 01:04:58.256524 run create_hlr_db(pid=21875): Terminated: ok {rc=0} 01:04:58.677845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21877): Launched 01:04:58.980487 run osmo-hlr_10.42.42.2(pid=21878): Launched 01:04:59.094743 run osmo-stp_10.42.42.5: Starting osmo-stp 01:04:59.629816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21880): Launched 01:04:59.932285 run osmo-stp_10.42.42.5(pid=21881): Launched 01:05:00.045906 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:05:00.567474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21883): Launched 01:05:00.684377 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:05:00.957845 run patchelf(pid=21884): Launched 01:05:01.156380 run osmo-stp_10.42.42.5(pid=21881): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21881)] 01:05:01.299383 run osmo-stp_10.42.42.5(pid=21881): stdout: | (launched: 2022-12-14_01:04:59.876225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:01.465730 run osmo-stp_10.42.42.5(pid=21881): stderr: | [0;m[38;5;43m20221214010500044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010500044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010500045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010500045 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010500046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010500046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010500046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:01.625274 run osmo-stp_10.42.42.5(pid=21881): stdout: | (launched: 2022-12-14_01:04:59.876225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:01.768408 run osmo-stp_10.42.42.5(pid=21881): stderr: | [0;m[38;5;43m20221214010500044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010500044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010500045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010500045 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010500046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010500046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010500046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:01.934172 run patchelf(pid=21884): Terminating (SIGINT) 01:05:02.139580 run patchelf(pid=21884): Terminated: ok {rc=0} 01:05:02.274779 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21881): Process ended prematurely: osmo-stp_10.42.42.5(pid=21881) [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21881)] [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 01:05:02.285794 tst iperf3.py:8: Test FAILED (7.6 sec) 01:05:02.315292 run osmo-hlr_10.42.42.2(pid=21878): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21878)] 01:05:02.368573 run osmo-hlr_10.42.42.2(pid=21878): stdout: | (launched: 2022-12-14_01:04:58.924801) 01:05:02.421696 run osmo-hlr_10.42.42.2(pid=21878): stderr: | [0;m[1;31m20221214010459095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010459095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010459095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010459096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010459096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010459096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010459108 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010459116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010459116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010459116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:05:02.475309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21873): Terminating (SIGTERM) 01:05:02.517406 run iperf3-srv_10.42.42.10(pid=21874): Terminating (SIGTERM) 01:05:02.560329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21877): Terminating (SIGTERM) 01:05:02.603370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21880): Terminating (SIGTERM) 01:05:02.646793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21883): Terminating (SIGTERM) 01:05:02.690530 --- ParallelTerminationStrategy: PID 21873 died... 01:05:02.711075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21873): Terminated: ok {rc=0} 01:05:02.758271 --- ParallelTerminationStrategy: PID 21874 died... 01:05:02.778637 run iperf3-srv_10.42.42.10(pid=21874): Terminated {rc=256} 01:05:02.825620 --- ParallelTerminationStrategy: PID 21877 died... 01:05:02.845937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21877): Terminated: ok {rc=0} 01:05:02.892620 --- ParallelTerminationStrategy: PID 21880 died... 01:05:02.912925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21880): Terminated: ok {rc=0} 01:05:02.960103 --- ParallelTerminationStrategy: PID 21883 died... 01:05:02.980638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21883): Terminated: ok {rc=0} 01:05:03.070026 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:05:04.216722 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:04.228299 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:05:04.298422 tst iperf3m4.py: using LAC 37472 01:05:04.416753 tst iperf3m4.py: using RAC 242 01:05:04.549531 tst iperf3m4.py: using CellId 37472 01:05:04.678350 tst iperf3m4.py: using BVCI 37473 01:05:04.797118 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:04.808577 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:04.820019 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:04.831395 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:04.843293 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:04.855260 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:04.867329 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:04.879221 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:04.891278 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:05:05.009763 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:05:05.131720 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:05:05.249617 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:05:05.368584 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:05:05.590378 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:05.920646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21888): Launched 01:05:06.206478 run iperf3-srv_10.42.42.10(pid=21889): Launched 01:05:06.329798 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:05:06.550311 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:06.879590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21890): Launched 01:05:07.165379 run iperf3-srv_10.42.42.10(pid=21891): Launched 01:05:07.288605 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:05:07.509051 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:07.838184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21892): Launched 01:05:08.122671 run iperf3-srv_10.42.42.10(pid=21893): Launched 01:05:08.247489 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:05:08.467770 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:08.797096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21894): Launched 01:05:09.081514 run iperf3-srv_10.42.42.10(pid=21895): Launched 01:05:09.206470 tst iperf3m4.py:8: start network... 01:05:09.428080 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:05:09.936017 run create_hlr_db(pid=21896): Launched 01:05:10.060300 bus /gobi_6: Setting Powered False 01:05:11.123734 run create_hlr_db(pid=21896): Terminated: ok {rc=0} 01:05:11.558099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21898): Launched 01:05:11.864661 run osmo-hlr_10.42.42.2(pid=21899): Launched 01:05:11.979310 run osmo-stp_10.42.42.5: Starting osmo-stp 01:05:12.520495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21901): Launched 01:05:12.823817 run osmo-stp_10.42.42.5(pid=21902): Launched 01:05:12.938799 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:05:13.463019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21904): Launched 01:05:13.579857 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:05:13.835425 run patchelf(pid=21905): Launched 01:05:14.005260 run osmo-stp_10.42.42.5(pid=21902): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21902)] 01:05:14.133529 run osmo-stp_10.42.42.5(pid=21902): stdout: | (launched: 2022-12-14_01:05:12.768014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:14.263831 run osmo-stp_10.42.42.5(pid=21902): stderr: | [0;m[38;5;43m20221214010512934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010512934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010512934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010512934 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010512935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010512935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010512935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:14.393977 run osmo-stp_10.42.42.5(pid=21902): stdout: | (launched: 2022-12-14_01:05:12.768014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:14.517228 run osmo-stp_10.42.42.5(pid=21902): stderr: | [0;m[38;5;43m20221214010512934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010512934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010512934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010512934 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010512935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010512935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010512935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:14.663641 run patchelf(pid=21905): Terminating (SIGINT) 01:05:14.833991 run patchelf(pid=21905): Terminated: ok {rc=0} 01:05:14.956744 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21902): Process ended prematurely: osmo-stp_10.42.42.5(pid=21902) [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21902)] [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:05:14.966287 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:05:14.993523 run osmo-hlr_10.42.42.2(pid=21899): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21899)] 01:05:15.040339 run osmo-hlr_10.42.42.2(pid=21899): stdout: | (launched: 2022-12-14_01:05:11.808415) 01:05:15.088760 run osmo-hlr_10.42.42.2(pid=21899): stderr: | [0;m[1;31m20221214010511981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010511981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010511981 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010511982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010511982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010511982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010511995 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010512003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010512003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010512003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:05:15.137570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21888): Terminating (SIGTERM) 01:05:15.177025 run iperf3-srv_10.42.42.10(pid=21889): Terminating (SIGTERM) 01:05:15.216275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21890): Terminating (SIGTERM) 01:05:15.255563 run iperf3-srv_10.42.42.10(pid=21891): Terminating (SIGTERM) 01:05:15.294845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21892): Terminating (SIGTERM) 01:05:15.334266 run iperf3-srv_10.42.42.10(pid=21893): Terminating (SIGTERM) 01:05:15.373528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21894): Terminating (SIGTERM) 01:05:15.412794 run iperf3-srv_10.42.42.10(pid=21895): Terminating (SIGTERM) 01:05:15.451993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21898): Terminating (SIGTERM) 01:05:15.490947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21901): Terminating (SIGTERM) 01:05:15.530003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21904): Terminating (SIGTERM) 01:05:15.569828 --- ParallelTerminationStrategy: PID 21888 died... 01:05:15.588774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21888): Terminated: ok {rc=0} 01:05:15.632537 --- ParallelTerminationStrategy: PID 21889 died... 01:05:15.651097 run iperf3-srv_10.42.42.10(pid=21889): Terminated {rc=256} 01:05:15.694369 --- ParallelTerminationStrategy: PID 21890 died... 01:05:15.712717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21890): Terminated: ok {rc=0} 01:05:15.756264 --- ParallelTerminationStrategy: PID 21891 died... 01:05:15.774830 run iperf3-srv_10.42.42.10(pid=21891): Terminated {rc=256} 01:05:15.818295 --- ParallelTerminationStrategy: PID 21892 died... 01:05:15.844353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21892): Terminated: ok {rc=0} 01:05:15.908931 --- ParallelTerminationStrategy: PID 21893 died... 01:05:15.938622 run iperf3-srv_10.42.42.10(pid=21893): Terminated {rc=256} 01:05:15.983274 --- ParallelTerminationStrategy: PID 21894 died... 01:05:16.002412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21894): Terminated: ok {rc=0} 01:05:16.050329 --- ParallelTerminationStrategy: PID 21895 died... 01:05:16.070255 run iperf3-srv_10.42.42.10(pid=21895): Terminated {rc=256} 01:05:16.115612 --- ParallelTerminationStrategy: PID 21898 died... 01:05:16.135604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21898): Terminated: ok {rc=0} 01:05:16.181218 --- ParallelTerminationStrategy: PID 21901 died... 01:05:16.201140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21901): Terminated: ok {rc=0} 01:05:16.246610 --- ParallelTerminationStrategy: PID 21904 died... 01:05:16.266471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21904): Terminated: ok {rc=0} 01:05:16.353302 bus /gobi_4: Setting Powered False 01:05:17.449603 bus /gobi_4: Setting Powered False 01:05:18.564928 bus /gobi_1: Setting Powered False 01:05:19.663069 bus /gobi_1: Setting Powered False 01:05:20.778859 bus /gobi_0: Setting Powered False 01:05:21.877087 bus /gobi_0: Setting Powered False 01:05:22.992064 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:05:24.095131 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:24.106726 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:05:24.180067 tst ping.py: using LAC 37473 01:05:24.296547 tst ping.py: using RAC 243 01:05:24.411159 tst ping.py: using CellId 37473 01:05:24.526357 tst ping.py: using BVCI 37474 01:05:24.634782 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:24.645780 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:24.656451 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:24.667246 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:24.677799 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:24.688395 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:24.699192 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:24.709791 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:05:24.823174 tst ping.py:19: start network... 01:05:25.021668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:05:25.480723 run create_hlr_db(pid=21906): Launched 01:05:25.602399 bus /gobi_6: Setting Powered False 01:05:26.661501 run create_hlr_db(pid=21906): Terminated: ok {rc=0} 01:05:27.099261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21908): Launched 01:05:27.420352 run osmo-hlr_10.42.42.2(pid=21909): Launched 01:05:27.542884 run osmo-stp_10.42.42.5: Starting osmo-stp 01:05:28.096724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21911): Launched 01:05:28.415701 run osmo-stp_10.42.42.5(pid=21912): Launched 01:05:28.536515 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:05:29.086820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21914): Launched 01:05:29.210720 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:05:29.479305 run patchelf(pid=21915): Launched 01:05:29.658304 run osmo-stp_10.42.42.5(pid=21912): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21912)] 01:05:29.793490 run osmo-stp_10.42.42.5(pid=21912): stdout: | (launched: 2022-12-14_01:05:28.356860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:29.930676 run osmo-stp_10.42.42.5(pid=21912): stderr: | [0;m[38;5;43m20221214010528544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010528544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010528544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010528545 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010528545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010528545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010528545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:30.068023 run osmo-stp_10.42.42.5(pid=21912): stdout: | (launched: 2022-12-14_01:05:28.356860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:30.198778 run osmo-stp_10.42.42.5(pid=21912): stderr: | [0;m[38;5;43m20221214010528544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010528544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010528544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010528545 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010528545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010528545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010528545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:30.353654 run patchelf(pid=21915): Terminating (SIGINT) 01:05:30.531532 run patchelf(pid=21915): Terminated: ok {rc=0} 01:05:30.660581 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21912): Process ended prematurely: osmo-stp_10.42.42.5(pid=21912) [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21912)] [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 01:05:30.670231 tst ping.py:22: Test FAILED (6.6 sec) 01:05:30.698341 run osmo-hlr_10.42.42.2(pid=21909): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21909)] 01:05:30.748544 run osmo-hlr_10.42.42.2(pid=21909): stdout: | (launched: 2022-12-14_01:05:27.362274) 01:05:30.800266 run osmo-hlr_10.42.42.2(pid=21909): stderr: | [0;m[1;31m20221214010527556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010527556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010527556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010527556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010527556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010527556 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010527569 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010527577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010527577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010527577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:05:30.865943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21908): Terminating (SIGTERM) 01:05:30.909905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21911): Terminating (SIGTERM) 01:05:30.953450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21914): Terminating (SIGTERM) 01:05:30.996174 --- ParallelTerminationStrategy: PID 21908 died... 01:05:31.016740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21908): Terminated: ok {rc=0} 01:05:31.063759 --- ParallelTerminationStrategy: PID 21911 died... 01:05:31.083769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21911): Terminated: ok {rc=0} 01:05:31.129308 --- ParallelTerminationStrategy: PID 21914 died... 01:05:31.150602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21914): Terminated: ok {rc=0} 01:05:31.240811 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:05:32.335332 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:32.347290 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:05:32.417846 tst ping_idle_ping.py: using LAC 37474 01:05:32.535072 tst ping_idle_ping.py: using RAC 244 01:05:32.664121 tst ping_idle_ping.py: using CellId 37474 01:05:32.793587 tst ping_idle_ping.py: using BVCI 37475 01:05:32.904541 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:32.915555 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:32.926312 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:32.937042 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:32.947556 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:32.958171 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:32.969456 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:05:32.980115 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:05:33.100146 tst ping_idle_ping.py:24: start network... 01:05:33.317642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:05:33.819925 run create_hlr_db(pid=21916): Launched 01:05:33.941743 bus /gobi_6: Setting Powered False 01:05:35.004831 run create_hlr_db(pid=21916): Terminated: ok {rc=0} 01:05:35.432475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21918): Launched 01:05:35.730492 run osmo-hlr_10.42.42.2(pid=21919): Launched 01:05:35.843519 run osmo-stp_10.42.42.5: Starting osmo-stp 01:05:36.356562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21921): Launched 01:05:36.654785 run osmo-stp_10.42.42.5(pid=21922): Launched 01:05:36.766978 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:05:37.279533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21924): Launched 01:05:37.392888 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:05:37.644064 run patchelf(pid=21925): Launched 01:05:37.809242 run osmo-stp_10.42.42.5(pid=21922): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21922)] 01:05:37.935792 run osmo-stp_10.42.42.5(pid=21922): stdout: | (launched: 2022-12-14_01:05:36.600031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:38.063415 run osmo-stp_10.42.42.5(pid=21922): stderr: | [0;m[38;5;43m20221214010536768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010536769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010536769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010536769 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010536770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010536770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010536770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:38.191122 run osmo-stp_10.42.42.5(pid=21922): stdout: | (launched: 2022-12-14_01:05:36.600031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:38.312115 run osmo-stp_10.42.42.5(pid=21922): stderr: | [0;m[38;5;43m20221214010536768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010536769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010536769 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010536769 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010536770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010536770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010536770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:38.455668 run patchelf(pid=21925): Terminating (SIGINT) 01:05:38.621735 run patchelf(pid=21925): Terminated: ok {rc=0} 01:05:38.741607 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21922): Process ended prematurely: osmo-stp_10.42.42.5(pid=21922) [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21922)] [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:05:38.750496 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 01:05:38.777022 run osmo-hlr_10.42.42.2(pid=21919): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21919)] 01:05:38.824381 run osmo-hlr_10.42.42.2(pid=21919): stdout: | (launched: 2022-12-14_01:05:35.675718) 01:05:38.873201 run osmo-hlr_10.42.42.2(pid=21919): stderr: | [0;m[1;31m20221214010535849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010535849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010535849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010535849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010535849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010535849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010535861 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010535870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010535870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010535870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:05:38.922753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21918): Terminating (SIGTERM) 01:05:38.962245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21921): Terminating (SIGTERM) 01:05:39.001488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21924): Terminating (SIGTERM) 01:05:39.040922 --- ParallelTerminationStrategy: PID 21918 died... 01:05:39.059987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21918): Terminated: ok {rc=0} 01:05:39.103763 --- ParallelTerminationStrategy: PID 21921 died... 01:05:39.122275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21921): Terminated: ok {rc=0} 01:05:39.165613 --- ParallelTerminationStrategy: PID 21924 died... 01:05:39.184051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21924): Terminated: ok {rc=0} 01:05:39.266982 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:05:40.568893 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:05:40.575547 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:05:40.608544 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 01:05:40.647799 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 01:05:40.734096 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:05:40.766813 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 01:05:40.805062 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 01:05:41.398080 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 01:05:41.446531 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:41.457648 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:05:41.527140 tst cs_paging_gprs_active.py: using LAC 37475 01:05:41.648702 tst cs_paging_gprs_active.py: using RAC 245 01:05:41.766965 tst cs_paging_gprs_active.py: using CellId 37475 01:05:41.899254 tst cs_paging_gprs_active.py: using BVCI 37476 01:05:42.031414 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:42.042792 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:42.054078 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:42.065283 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:42.076727 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:42.088222 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:42.099827 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:42.111277 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:42.122841 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:05:42.239683 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:05:42.360379 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:05:42.581713 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:42.909455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21930): Launched 01:05:43.195854 run iperf3-srv_10.42.42.10(pid=21931): Launched 01:05:43.318064 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:05:43.538727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:43.866440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21932): Launched 01:05:44.150933 run iperf3-srv_10.42.42.10(pid=21933): Launched 01:05:44.273594 tst cs_paging_gprs_active.py:38: start network... 01:05:44.493418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:05:44.998427 run create_hlr_db(pid=21934): Launched 01:05:45.123174 bus /gobi_6: Setting Powered False 01:05:46.206317 run create_hlr_db(pid=21934): Terminated: ok {rc=0} 01:05:46.710254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21936): Launched 01:05:47.035165 run osmo-hlr_10.42.42.2(pid=21937): Launched 01:05:47.274768 run osmo-stp_10.42.42.5: Starting osmo-stp 01:05:47.811990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21939): Launched 01:05:48.115059 run osmo-stp_10.42.42.5(pid=21940): Launched 01:05:48.231627 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:05:48.754663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21942): Launched 01:05:48.872421 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:05:49.128913 run patchelf(pid=21943): Launched 01:05:49.297949 run osmo-stp_10.42.42.5(pid=21940): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21940)] 01:05:49.426133 run osmo-stp_10.42.42.5(pid=21940): stdout: | (launched: 2022-12-14_01:05:48.059014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:49.555405 run osmo-stp_10.42.42.5(pid=21940): stderr: | [0;m[38;5;43m20221214010548225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010548226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010548226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010548226 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010548227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010548227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010548227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:49.685220 run osmo-stp_10.42.42.5(pid=21940): stdout: | (launched: 2022-12-14_01:05:48.059014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:05:49.808851 run osmo-stp_10.42.42.5(pid=21940): stderr: | [0;m[38;5;43m20221214010548225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010548226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010548226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010548226 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010548227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010548227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010548227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:05:49.955428 run patchelf(pid=21943): Terminating (SIGINT) 01:05:50.125363 run patchelf(pid=21943): Terminated: ok {rc=0} 01:05:50.247347 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21940): Process ended prematurely: osmo-stp_10.42.42.5(pid=21940) [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21940)] [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 01:05:50.256871 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:05:50.283833 run osmo-hlr_10.42.42.2(pid=21937): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21937)] 01:05:50.331081 run osmo-hlr_10.42.42.2(pid=21937): stdout: | (launched: 2022-12-14_01:05:46.968773) 01:05:50.379863 run osmo-hlr_10.42.42.2(pid=21937): stderr: | [0;m[1;31m20221214010547236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010547236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010547236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010547236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010547236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010547236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010547257 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010547265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010547266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010547266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:05:50.428912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21930): Terminating (SIGTERM) 01:05:50.467951 run iperf3-srv_10.42.42.10(pid=21931): Terminating (SIGTERM) 01:05:50.506862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21932): Terminating (SIGTERM) 01:05:50.545965 run iperf3-srv_10.42.42.10(pid=21933): Terminating (SIGTERM) 01:05:50.585123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21936): Terminating (SIGTERM) 01:05:50.624190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21939): Terminating (SIGTERM) 01:05:50.663453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21942): Terminating (SIGTERM) 01:05:50.702819 --- ParallelTerminationStrategy: PID 21930 died... 01:05:50.721852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21930): Terminated: ok {rc=0} 01:05:50.765239 --- ParallelTerminationStrategy: PID 21931 died... 01:05:50.783978 run iperf3-srv_10.42.42.10(pid=21931): Terminated {rc=256} 01:05:50.827203 --- ParallelTerminationStrategy: PID 21932 died... 01:05:50.845658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21932): Terminated: ok {rc=0} 01:05:50.888599 --- ParallelTerminationStrategy: PID 21933 died... 01:05:50.906904 run iperf3-srv_10.42.42.10(pid=21933): Terminated {rc=256} 01:05:50.949899 --- ParallelTerminationStrategy: PID 21936 died... 01:05:50.968245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21936): Terminated: ok {rc=0} 01:05:51.011425 --- ParallelTerminationStrategy: PID 21939 died... 01:05:51.030222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21939): Terminated: ok {rc=0} 01:05:51.073523 --- ParallelTerminationStrategy: PID 21942 died... 01:05:51.092029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21942): Terminated: ok {rc=0} 01:05:51.176458 bus /gobi_0: Setting Powered False 01:05:52.274333 bus /gobi_0: Setting Powered False 01:05:53.384512 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 01:05:54.533182 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:54.545521 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:05:54.621109 tst iperf3.py: using LAC 37476 01:05:54.749601 tst iperf3.py: using RAC 246 01:05:54.868523 tst iperf3.py: using CellId 37476 01:05:54.995513 tst iperf3.py: using BVCI 37477 01:05:55.107126 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:55.118131 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:55.128649 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:55.139480 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:55.150312 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:55.161135 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:55.171744 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:55.182227 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:05:55.192894 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:05:55.311909 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:05:55.532050 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:05:55.859446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21944): Launched 01:05:56.143681 run iperf3-srv_10.42.42.10(pid=21945): Launched 01:05:56.266187 tst iperf3.py:8: start network... 01:05:56.485664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:05:56.988528 run create_hlr_db(pid=21946): Launched 01:05:57.115396 bus /gobi_6: Setting Powered False 01:05:58.178848 run create_hlr_db(pid=21946): Terminated: ok {rc=0} 01:05:58.613590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21948): Launched 01:05:58.917104 run osmo-hlr_10.42.42.2(pid=21949): Launched 01:05:59.031960 run osmo-stp_10.42.42.5: Starting osmo-stp 01:05:59.551172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21951): Launched 01:05:59.852786 run osmo-stp_10.42.42.5(pid=21952): Launched 01:05:59.967127 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:06:00.487110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21954): Launched 01:06:00.603009 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:06:00.879959 run patchelf(pid=21955): Launched 01:06:01.091059 run osmo-stp_10.42.42.5(pid=21952): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21952)] 01:06:01.279854 run osmo-stp_10.42.42.5(pid=21952): stdout: | (launched: 2022-12-14_01:05:59.796669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:01.413452 run osmo-stp_10.42.42.5(pid=21952): stderr: | [0;m[38;5;43m20221214010559965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010559965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010559966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010559966 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010559966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010559967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010559967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:01.544905 run osmo-stp_10.42.42.5(pid=21952): stdout: | (launched: 2022-12-14_01:05:59.796669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:01.670267 run osmo-stp_10.42.42.5(pid=21952): stderr: | [0;m[38;5;43m20221214010559965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010559965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010559966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010559966 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010559966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010559967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010559967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:01.818639 run patchelf(pid=21955): Terminating (SIGINT) 01:06:01.990039 run patchelf(pid=21955): Terminated: ok {rc=0} 01:06:02.114909 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21952): Process ended prematurely: osmo-stp_10.42.42.5(pid=21952) [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21952)] [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 01:06:02.124852 tst iperf3.py:8: Test FAILED (7.6 sec) 01:06:02.152366 run osmo-hlr_10.42.42.2(pid=21949): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21949)] 01:06:02.199776 run osmo-hlr_10.42.42.2(pid=21949): stdout: | (launched: 2022-12-14_01:05:58.861132) 01:06:02.249176 run osmo-hlr_10.42.42.2(pid=21949): stderr: | [0;m[1;31m20221214010559032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010559032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010559032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010559032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010559032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010559032 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010559044 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010559052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010559052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010559052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:06:02.298320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21944): Terminating (SIGTERM) 01:06:02.337585 run iperf3-srv_10.42.42.10(pid=21945): Terminating (SIGTERM) 01:06:02.376932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21948): Terminating (SIGTERM) 01:06:02.416281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21951): Terminating (SIGTERM) 01:06:02.455614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21954): Terminating (SIGTERM) 01:06:02.495099 --- ParallelTerminationStrategy: PID 21944 died... 01:06:02.514083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21944): Terminated: ok {rc=0} 01:06:02.557507 --- ParallelTerminationStrategy: PID 21945 died... 01:06:02.575734 run iperf3-srv_10.42.42.10(pid=21945): Terminated {rc=256} 01:06:02.618762 --- ParallelTerminationStrategy: PID 21948 died... 01:06:02.637104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21948): Terminated: ok {rc=0} 01:06:02.680619 --- ParallelTerminationStrategy: PID 21951 died... 01:06:02.699008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21951): Terminated: ok {rc=0} 01:06:02.742072 --- ParallelTerminationStrategy: PID 21954 died... 01:06:02.760923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21954): Terminated: ok {rc=0} 01:06:02.846513 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 01:06:03.996164 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:04.007689 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:06:04.079365 tst iperf3m4.py: using LAC 37477 01:06:04.207641 tst iperf3m4.py: using RAC 247 01:06:04.336658 tst iperf3m4.py: using CellId 37477 01:06:04.464301 tst iperf3m4.py: using BVCI 37478 01:06:04.584580 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:04.596234 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:04.607589 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:04.619031 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:04.630633 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:04.642182 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:04.653954 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:04.665933 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:04.677738 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:06:04.799407 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:06:04.919350 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:06:05.040077 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:06:05.160306 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:06:05.381077 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:05.709378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21957): Launched 01:06:05.994796 run iperf3-srv_10.42.42.10(pid=21958): Launched 01:06:06.117366 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:06:06.336743 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:06.664242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21959): Launched 01:06:06.948058 run iperf3-srv_10.42.42.10(pid=21960): Launched 01:06:07.070367 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:06:07.290146 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:07.617117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21961): Launched 01:06:07.900429 run iperf3-srv_10.42.42.10(pid=21962): Launched 01:06:08.022494 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:06:08.241872 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:08.568530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21963): Launched 01:06:08.852757 run iperf3-srv_10.42.42.10(pid=21964): Launched 01:06:08.974685 tst iperf3m4.py:8: start network... 01:06:09.193653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:06:09.696550 run create_hlr_db(pid=21965): Launched 01:06:09.820669 bus /gobi_6: Setting Powered False 01:06:10.885125 run create_hlr_db(pid=21965): Terminated: ok {rc=0} 01:06:11.318714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21967): Launched 01:06:11.621653 run osmo-hlr_10.42.42.2(pid=21968): Launched 01:06:11.737795 run osmo-stp_10.42.42.5: Starting osmo-stp 01:06:12.269681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21970): Launched 01:06:12.573568 run osmo-stp_10.42.42.5(pid=21971): Launched 01:06:12.689546 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:06:13.216028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21973): Launched 01:06:13.332752 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:06:13.587868 run patchelf(pid=21974): Launched 01:06:13.756835 run osmo-stp_10.42.42.5(pid=21971): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21971)] 01:06:13.884745 run osmo-stp_10.42.42.5(pid=21971): stdout: | (launched: 2022-12-14_01:06:12.517284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:14.014639 run osmo-stp_10.42.42.5(pid=21971): stderr: | [0;m[38;5;43m20221214010612685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010612686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010612686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010612686 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010612687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010612687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010612687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:14.144513 run osmo-stp_10.42.42.5(pid=21971): stdout: | (launched: 2022-12-14_01:06:12.517284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:14.267980 run osmo-stp_10.42.42.5(pid=21971): stderr: | [0;m[38;5;43m20221214010612685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010612686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010612686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010612686 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010612687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010612687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010612687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:14.414144 run patchelf(pid=21974): Terminating (SIGINT) 01:06:14.582580 run patchelf(pid=21974): Terminated: ok {rc=0} 01:06:14.704570 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21971): Process ended prematurely: osmo-stp_10.42.42.5(pid=21971) [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21971)] [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 01:06:14.714133 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:06:14.741459 run osmo-hlr_10.42.42.2(pid=21968): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21968)] 01:06:14.788609 run osmo-hlr_10.42.42.2(pid=21968): stdout: | (launched: 2022-12-14_01:06:11.565700) 01:06:14.837339 run osmo-hlr_10.42.42.2(pid=21968): stderr: | [0;m[1;31m20221214010611739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010611739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010611739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010611740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010611740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010611740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010611753 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010611763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010611763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010611763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:06:14.886345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21957): Terminating (SIGTERM) 01:06:14.925750 run iperf3-srv_10.42.42.10(pid=21958): Terminating (SIGTERM) 01:06:14.965159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21959): Terminating (SIGTERM) 01:06:15.004560 run iperf3-srv_10.42.42.10(pid=21960): Terminating (SIGTERM) 01:06:15.043800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21961): Terminating (SIGTERM) 01:06:15.083156 run iperf3-srv_10.42.42.10(pid=21962): Terminating (SIGTERM) 01:06:15.122306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21963): Terminating (SIGTERM) 01:06:15.161317 run iperf3-srv_10.42.42.10(pid=21964): Terminating (SIGTERM) 01:06:15.200237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21967): Terminating (SIGTERM) 01:06:15.240023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21970): Terminating (SIGTERM) 01:06:15.279123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21973): Terminating (SIGTERM) 01:06:15.318349 --- ParallelTerminationStrategy: PID 21957 died... 01:06:15.337291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21957): Terminated: ok {rc=0} 01:06:15.380597 --- ParallelTerminationStrategy: PID 21958 died... 01:06:15.398954 run iperf3-srv_10.42.42.10(pid=21958): Terminated {rc=256} 01:06:15.442368 --- ParallelTerminationStrategy: PID 21959 died... 01:06:15.460556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21959): Terminated: ok {rc=0} 01:06:15.503830 --- ParallelTerminationStrategy: PID 21960 died... 01:06:15.522304 run iperf3-srv_10.42.42.10(pid=21960): Terminated {rc=256} 01:06:15.565275 --- ParallelTerminationStrategy: PID 21961 died... 01:06:15.583728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21961): Terminated: ok {rc=0} 01:06:15.626786 --- ParallelTerminationStrategy: PID 21962 died... 01:06:15.645128 run iperf3-srv_10.42.42.10(pid=21962): Terminated {rc=256} 01:06:15.688089 --- ParallelTerminationStrategy: PID 21963 died... 01:06:15.706454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21963): Terminated: ok {rc=0} 01:06:15.749577 --- ParallelTerminationStrategy: PID 21964 died... 01:06:15.768330 run iperf3-srv_10.42.42.10(pid=21964): Terminated {rc=256} 01:06:15.811351 --- ParallelTerminationStrategy: PID 21967 died... 01:06:15.829767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21967): Terminated: ok {rc=0} 01:06:15.877766 --- ParallelTerminationStrategy: PID 21970 died... 01:06:15.901342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21970): Terminated: ok {rc=0} 01:06:15.945914 --- ParallelTerminationStrategy: PID 21973 died... 01:06:15.964886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21973): Terminated: ok {rc=0} 01:06:16.050036 bus /gobi_4: Setting Powered False 01:06:17.144246 bus /gobi_4: Setting Powered False 01:06:18.261655 bus /gobi_1: Setting Powered False 01:06:19.359995 bus /gobi_1: Setting Powered False 01:06:20.475995 bus /gobi_0: Setting Powered False 01:06:21.575244 bus /gobi_0: Setting Powered False 01:06:22.691691 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 01:06:23.796501 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:23.808570 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:06:23.881386 tst ping.py: using LAC 37478 01:06:24.007734 tst ping.py: using RAC 248 01:06:24.132192 tst ping.py: using CellId 37478 01:06:24.258337 tst ping.py: using BVCI 37479 01:06:24.374562 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:24.386040 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:24.397246 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:24.408448 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:24.420002 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:24.431547 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:24.443226 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:24.454705 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:06:24.570206 tst ping.py:19: start network... 01:06:24.769504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:06:25.230100 run create_hlr_db(pid=21975): Launched 01:06:25.352634 bus /gobi_6: Setting Powered False 01:06:26.412385 run create_hlr_db(pid=21975): Terminated: ok {rc=0} 01:06:26.828210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21977): Launched 01:06:27.125854 run osmo-hlr_10.42.42.2(pid=21978): Launched 01:06:27.237828 run osmo-stp_10.42.42.5: Starting osmo-stp 01:06:27.755513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21980): Launched 01:06:28.053166 run osmo-stp_10.42.42.5(pid=21981): Launched 01:06:28.165453 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:06:28.677842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21983): Launched 01:06:28.791867 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:06:29.043670 run patchelf(pid=21984): Launched 01:06:29.208502 run osmo-stp_10.42.42.5(pid=21981): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21981)] 01:06:29.333793 run osmo-stp_10.42.42.5(pid=21981): stdout: | (launched: 2022-12-14_01:06:27.998171) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:29.460758 run osmo-stp_10.42.42.5(pid=21981): stderr: | [0;m[38;5;43m20221214010628166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010628166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010628167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010628167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010628168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010628168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010628168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:29.587545 run osmo-stp_10.42.42.5(pid=21981): stdout: | (launched: 2022-12-14_01:06:27.998171) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:29.708162 run osmo-stp_10.42.42.5(pid=21981): stderr: | [0;m[38;5;43m20221214010628166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010628166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010628167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010628167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010628168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010628168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010628168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:29.851178 run patchelf(pid=21984): Terminating (SIGINT) 01:06:30.016390 run patchelf(pid=21984): Terminated: ok {rc=0} 01:06:30.135456 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21981): Process ended prematurely: osmo-stp_10.42.42.5(pid=21981) [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21981)] [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 01:06:30.144355 tst ping.py:22: Test FAILED (6.3 sec) 01:06:30.170750 run osmo-hlr_10.42.42.2(pid=21978): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21978)] 01:06:30.217509 run osmo-hlr_10.42.42.2(pid=21978): stdout: | (launched: 2022-12-14_01:06:27.070982) 01:06:30.266051 run osmo-hlr_10.42.42.2(pid=21978): stderr: | [0;m[1;31m20221214010627243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010627243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010627243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010627243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010627243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010627243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010627255 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010627266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010627266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010627266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:06:30.315019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21977): Terminating (SIGTERM) 01:06:30.354085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21980): Terminating (SIGTERM) 01:06:30.393191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21983): Terminating (SIGTERM) 01:06:30.432546 --- ParallelTerminationStrategy: PID 21977 died... 01:06:30.451741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21977): Terminated: ok {rc=0} 01:06:30.495246 --- ParallelTerminationStrategy: PID 21980 died... 01:06:30.513739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21980): Terminated: ok {rc=0} 01:06:30.556819 --- ParallelTerminationStrategy: PID 21983 died... 01:06:30.575760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21983): Terminated: ok {rc=0} 01:06:30.661323 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 01:06:31.755739 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:31.768140 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:06:31.846209 tst ping_idle_ping.py: using LAC 37479 01:06:32.001686 tst ping_idle_ping.py: using RAC 249 01:06:32.128356 tst ping_idle_ping.py: using CellId 37479 01:06:32.256038 tst ping_idle_ping.py: using BVCI 37480 01:06:32.374753 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:32.386398 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:32.397832 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:32.409342 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:32.421515 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:32.433605 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:32.446049 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:06:32.458336 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:06:32.580230 tst ping_idle_ping.py:24: start network... 01:06:32.796927 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:06:33.294342 run create_hlr_db(pid=21985): Launched 01:06:33.417301 bus /gobi_6: Setting Powered False 01:06:34.480491 run create_hlr_db(pid=21985): Terminated: ok {rc=0} 01:06:34.907804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21987): Launched 01:06:35.205532 run osmo-hlr_10.42.42.2(pid=21988): Launched 01:06:35.318217 run osmo-stp_10.42.42.5: Starting osmo-stp 01:06:35.835819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21990): Launched 01:06:36.134870 run osmo-stp_10.42.42.5(pid=21991): Launched 01:06:36.248278 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:06:36.761853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21993): Launched 01:06:36.875460 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:06:37.125567 run patchelf(pid=21994): Launched 01:06:37.291194 run osmo-stp_10.42.42.5(pid=21991): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21991)] 01:06:37.418321 run osmo-stp_10.42.42.5(pid=21991): stdout: | (launched: 2022-12-14_01:06:36.079902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:37.546794 run osmo-stp_10.42.42.5(pid=21991): stderr: | [0;m[38;5;43m20221214010636246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010636246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010636246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010636246 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010636247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010636247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010636247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:37.675090 run osmo-stp_10.42.42.5(pid=21991): stdout: | (launched: 2022-12-14_01:06:36.079902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:37.797100 run osmo-stp_10.42.42.5(pid=21991): stderr: | [0;m[38;5;43m20221214010636246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010636246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010636246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010636246 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010636247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010636247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010636247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:37.941739 run patchelf(pid=21994): Terminating (SIGINT) 01:06:38.108908 run patchelf(pid=21994): Terminated: ok {rc=0} 01:06:38.229505 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21991): Process ended prematurely: osmo-stp_10.42.42.5(pid=21991) [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21991)] [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 01:06:38.238329 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 01:06:38.264569 run osmo-hlr_10.42.42.2(pid=21988): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21988)] 01:06:38.311418 run osmo-hlr_10.42.42.2(pid=21988): stdout: | (launched: 2022-12-14_01:06:35.150990) 01:06:38.359913 run osmo-hlr_10.42.42.2(pid=21988): stderr: | [0;m[1;31m20221214010635322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010635322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010635322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010635322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010635322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010635322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010635335 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010635344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010635344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010635345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:06:38.408753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21987): Terminating (SIGTERM) 01:06:38.447761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21990): Terminating (SIGTERM) 01:06:38.486735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21993): Terminating (SIGTERM) 01:06:38.526011 --- ParallelTerminationStrategy: PID 21987 died... 01:06:38.544584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21987): Terminated: ok {rc=0} 01:06:38.588040 --- ParallelTerminationStrategy: PID 21990 died... 01:06:38.606534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21990): Terminated: ok {rc=0} 01:06:38.649606 --- ParallelTerminationStrategy: PID 21993 died... 01:06:38.668133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21993): Terminated: ok {rc=0} 01:06:38.752534 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 01:06:40.055344 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:06:40.061658 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 01:06:40.094428 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 01:06:40.133997 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 01:06:40.221699 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 01:06:40.254143 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 01:06:40.292254 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 01:06:40.891011 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 01:06:40.940438 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:40.951756 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:06:41.004766 tst cs_paging_gprs_active.py: using LAC 37480 01:06:41.125382 tst cs_paging_gprs_active.py: using RAC 250 01:06:41.244189 tst cs_paging_gprs_active.py: using CellId 37480 01:06:41.364909 tst cs_paging_gprs_active.py: using BVCI 37481 01:06:41.475339 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:41.486677 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:41.497805 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:41.508803 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:41.519884 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:41.530935 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:41.542092 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:41.553065 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:41.564336 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:06:41.684932 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:06:41.805421 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:06:42.010383 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:42.316821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21998): Launched 01:06:42.583009 run iperf3-srv_10.42.42.10(pid=21999): Launched 01:06:42.697339 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:06:42.900702 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:43.206268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22000): Launched 01:06:43.472830 run iperf3-srv_10.42.42.10(pid=22001): Launched 01:06:43.586940 tst cs_paging_gprs_active.py:38: start network... 01:06:43.789789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:06:44.256852 run create_hlr_db(pid=22002): Launched 01:06:44.380417 bus /gobi_6: Setting Powered False 01:06:45.440811 run create_hlr_db(pid=22002): Terminated: ok {rc=0} 01:06:45.890196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22004): Launched 01:06:46.245322 run osmo-hlr_10.42.42.2(pid=22005): Launched 01:06:46.501628 run osmo-stp_10.42.42.5: Starting osmo-stp 01:06:47.083935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22007): Launched 01:06:47.399857 run osmo-stp_10.42.42.5(pid=22008): Launched 01:06:47.527866 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:06:48.091534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22010): Launched 01:06:48.219171 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:06:48.495389 run patchelf(pid=22011): Launched 01:06:48.679437 run osmo-stp_10.42.42.5(pid=22008): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22008)] 01:06:48.818183 run osmo-stp_10.42.42.5(pid=22008): stdout: | (launched: 2022-12-14_01:06:47.343222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:48.957782 run osmo-stp_10.42.42.5(pid=22008): stderr: | [0;m[38;5;43m20221214010647526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010647526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010647527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010647527 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010647527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010647528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010647528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:49.097299 run osmo-stp_10.42.42.5(pid=22008): stdout: | (launched: 2022-12-14_01:06:47.343222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:06:49.231197 run osmo-stp_10.42.42.5(pid=22008): stderr: | [0;m[38;5;43m20221214010647526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010647526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010647527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010647527 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010647527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010647528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010647528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:06:49.389802 run patchelf(pid=22011): Terminating (SIGINT) 01:06:49.572533 run patchelf(pid=22011): Terminated: ok {rc=0} 01:06:49.704414 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22008): Process ended prematurely: osmo-stp_10.42.42.5(pid=22008) [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22008)] [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 01:06:49.714762 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:06:49.743389 run osmo-hlr_10.42.42.2(pid=22005): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22005)] 01:06:49.794048 run osmo-hlr_10.42.42.2(pid=22005): stdout: | (launched: 2022-12-14_01:06:46.186125) 01:06:49.846394 run osmo-hlr_10.42.42.2(pid=22005): stderr: | [0;m[1;31m20221214010646379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010646379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010646379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010646379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010646379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010646379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010646398 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010646421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010646424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010646424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:06:49.899145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21998): Terminating (SIGTERM) 01:06:49.941048 run iperf3-srv_10.42.42.10(pid=21999): Terminating (SIGTERM) 01:06:49.982953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22000): Terminating (SIGTERM) 01:06:50.025098 run iperf3-srv_10.42.42.10(pid=22001): Terminating (SIGTERM) 01:06:50.067400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22004): Terminating (SIGTERM) 01:06:50.109761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22007): Terminating (SIGTERM) 01:06:50.151930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22010): Terminating (SIGTERM) 01:06:50.194157 --- ParallelTerminationStrategy: PID 21998 died... 01:06:50.214765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21998): Terminated: ok {rc=0} 01:06:50.261426 --- ParallelTerminationStrategy: PID 21999 died... 01:06:50.281330 run iperf3-srv_10.42.42.10(pid=21999): Terminated {rc=256} 01:06:50.327783 --- ParallelTerminationStrategy: PID 22000 died... 01:06:50.347835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22000): Terminated: ok {rc=0} 01:06:50.394395 --- ParallelTerminationStrategy: PID 22001 died... 01:06:50.414376 run iperf3-srv_10.42.42.10(pid=22001): Terminated {rc=256} 01:06:50.460761 --- ParallelTerminationStrategy: PID 22004 died... 01:06:50.480779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22004): Terminated: ok {rc=0} 01:06:50.527114 --- ParallelTerminationStrategy: PID 22007 died... 01:06:50.547026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22007): Terminated: ok {rc=0} 01:06:50.592896 --- ParallelTerminationStrategy: PID 22010 died... 01:06:50.613254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22010): Terminated: ok {rc=0} 01:06:50.700773 bus /gobi_0: Setting Powered False 01:06:51.797247 bus /gobi_0: Setting Powered False 01:06:52.913420 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 01:06:54.061263 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:54.073789 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:06:54.133580 tst iperf3.py: using LAC 37481 01:06:54.260000 tst iperf3.py: using RAC 251 01:06:54.386087 tst iperf3.py: using CellId 37481 01:06:54.511293 tst iperf3.py: using BVCI 37482 01:06:54.630905 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:54.642746 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:54.654467 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:54.666134 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:54.678082 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:54.690329 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:54.702476 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:54.714257 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:06:54.726326 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:06:54.846288 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:06:55.066483 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:06:55.393727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22012): Launched 01:06:55.678381 run iperf3-srv_10.42.42.10(pid=22013): Launched 01:06:55.801991 tst iperf3.py:8: start network... 01:06:56.020697 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:06:56.522442 run create_hlr_db(pid=22014): Launched 01:06:56.647309 bus /gobi_6: Setting Powered False 01:06:57.711314 run create_hlr_db(pid=22014): Terminated: ok {rc=0} 01:06:58.162564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22016): Launched 01:06:58.488656 run osmo-hlr_10.42.42.2(pid=22017): Launched 01:06:58.612842 run osmo-stp_10.42.42.5: Starting osmo-stp 01:06:59.170551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22019): Launched 01:06:59.495894 run osmo-stp_10.42.42.5(pid=22020): Launched 01:06:59.619387 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:07:00.179188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22022): Launched 01:07:00.305913 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:07:00.580567 run patchelf(pid=22023): Launched 01:07:00.761777 run osmo-stp_10.42.42.5(pid=22020): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22020)] 01:07:00.922370 run osmo-stp_10.42.42.5(pid=22020): stdout: | (launched: 2022-12-14_01:06:59.436490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:01.058828 run osmo-stp_10.42.42.5(pid=22020): stderr: | [0;m[38;5;43m20221214010659626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010659626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010659626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010659626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010659627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010659627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010659627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:01.193375 run osmo-stp_10.42.42.5(pid=22020): stdout: | (launched: 2022-12-14_01:06:59.436490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:01.318911 run osmo-stp_10.42.42.5(pid=22020): stderr: | [0;m[38;5;43m20221214010659626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010659626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010659626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010659626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010659627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010659627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010659627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:01.469695 run patchelf(pid=22023): Terminating (SIGINT) 01:07:01.645973 run patchelf(pid=22023): Terminated: ok {rc=0} 01:07:01.774543 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22020): Process ended prematurely: osmo-stp_10.42.42.5(pid=22020) [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22020)] [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 01:07:01.785442 tst iperf3.py:8: Test FAILED (7.8 sec) 01:07:01.814015 run osmo-hlr_10.42.42.2(pid=22017): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22017)] 01:07:01.864339 run osmo-hlr_10.42.42.2(pid=22017): stdout: | (launched: 2022-12-14_01:06:58.429487) 01:07:01.915192 run osmo-hlr_10.42.42.2(pid=22017): stderr: | [0;m[1;31m20221214010658624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010658624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010658624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010658624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010658624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010658624 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010658637 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010658645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010658645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010658645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:07:01.966680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22012): Terminating (SIGTERM) 01:07:02.009104 run iperf3-srv_10.42.42.10(pid=22013): Terminating (SIGTERM) 01:07:02.051389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22016): Terminating (SIGTERM) 01:07:02.094008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22019): Terminating (SIGTERM) 01:07:02.138961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22022): Terminating (SIGTERM) 01:07:02.181400 --- ParallelTerminationStrategy: PID 22012 died... 01:07:02.200489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22012): Terminated: ok {rc=0} 01:07:02.244355 --- ParallelTerminationStrategy: PID 22013 died... 01:07:02.263054 run iperf3-srv_10.42.42.10(pid=22013): Terminated {rc=256} 01:07:02.306341 --- ParallelTerminationStrategy: PID 22016 died... 01:07:02.324731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22016): Terminated: ok {rc=0} 01:07:02.368207 --- ParallelTerminationStrategy: PID 22019 died... 01:07:02.386802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22019): Terminated: ok {rc=0} 01:07:02.430321 --- ParallelTerminationStrategy: PID 22022 died... 01:07:02.448704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22022): Terminated: ok {rc=0} 01:07:02.532086 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 01:07:03.680160 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:03.693134 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:07:03.750145 tst iperf3m4.py: using LAC 37482 01:07:03.878766 tst iperf3m4.py: using RAC 252 01:07:04.007263 tst iperf3m4.py: using CellId 37482 01:07:04.133964 tst iperf3m4.py: using BVCI 37483 01:07:04.251540 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:04.263542 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:04.275287 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:04.287116 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:04.299149 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:04.311197 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:04.323310 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:04.335363 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:04.347605 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:07:04.468052 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:07:04.587381 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:07:04.706335 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:07:04.825642 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:07:05.045656 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:07:05.371832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22024): Launched 01:07:05.654841 run iperf3-srv_10.42.42.10(pid=22025): Launched 01:07:05.779460 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:07:05.998657 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:07:06.324785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22026): Launched 01:07:06.607307 run iperf3-srv_10.42.42.10(pid=22027): Launched 01:07:06.731275 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:07:06.950383 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:07:07.277292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22028): Launched 01:07:07.559585 run iperf3-srv_10.42.42.10(pid=22029): Launched 01:07:07.683173 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:07:07.902558 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:07:08.228381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22030): Launched 01:07:08.511840 run iperf3-srv_10.42.42.10(pid=22031): Launched 01:07:08.635116 tst iperf3m4.py:8: start network... 01:07:08.854223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:07:09.357524 run create_hlr_db(pid=22032): Launched 01:07:09.483029 bus /gobi_6: Setting Powered False 01:07:10.546514 run create_hlr_db(pid=22032): Terminated: ok {rc=0} 01:07:10.997151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22034): Launched 01:07:11.321664 run osmo-hlr_10.42.42.2(pid=22035): Launched 01:07:11.447700 run osmo-stp_10.42.42.5: Starting osmo-stp 01:07:11.983670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22037): Launched 01:07:12.286700 run osmo-stp_10.42.42.5(pid=22038): Launched 01:07:12.401721 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:07:12.922296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22040): Launched 01:07:13.037657 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:07:13.291373 run patchelf(pid=22041): Launched 01:07:13.459436 run osmo-stp_10.42.42.5(pid=22038): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22038)] 01:07:13.587025 run osmo-stp_10.42.42.5(pid=22038): stdout: | (launched: 2022-12-14_01:07:12.231050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:13.717428 run osmo-stp_10.42.42.5(pid=22038): stderr: | [0;m[38;5;43m20221214010712397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010712397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010712397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010712397 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010712398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010712398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010712398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:13.847088 run osmo-stp_10.42.42.5(pid=22038): stdout: | (launched: 2022-12-14_01:07:12.231050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:13.969777 run osmo-stp_10.42.42.5(pid=22038): stderr: | [0;m[38;5;43m20221214010712397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010712397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010712397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010712397 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010712398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010712398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010712398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:14.115749 run patchelf(pid=22041): Terminating (SIGINT) 01:07:14.283875 run patchelf(pid=22041): Terminated: ok {rc=0} 01:07:14.405807 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22038): Process ended prematurely: osmo-stp_10.42.42.5(pid=22038) [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22038)] [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 01:07:14.415327 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:07:14.442547 run osmo-hlr_10.42.42.2(pid=22035): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22035)] 01:07:14.489676 run osmo-hlr_10.42.42.2(pid=22035): stdout: | (launched: 2022-12-14_01:07:11.262089) 01:07:14.538544 run osmo-hlr_10.42.42.2(pid=22035): stderr: | [0;m[1;31m20221214010711455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010711455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010711455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010711455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010711455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010711455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010711467 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010711476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010711476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010711476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:07:14.587514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22024): Terminating (SIGTERM) 01:07:14.626486 run iperf3-srv_10.42.42.10(pid=22025): Terminating (SIGTERM) 01:07:14.665530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22026): Terminating (SIGTERM) 01:07:14.704533 run iperf3-srv_10.42.42.10(pid=22027): Terminating (SIGTERM) 01:07:14.743436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22028): Terminating (SIGTERM) 01:07:14.782406 run iperf3-srv_10.42.42.10(pid=22029): Terminating (SIGTERM) 01:07:14.821414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22030): Terminating (SIGTERM) 01:07:14.860569 run iperf3-srv_10.42.42.10(pid=22031): Terminating (SIGTERM) 01:07:14.899431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22034): Terminating (SIGTERM) 01:07:14.938423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22037): Terminating (SIGTERM) 01:07:14.977472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22040): Terminating (SIGTERM) 01:07:15.017254 --- ParallelTerminationStrategy: PID 22024 died... 01:07:15.036328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22024): Terminated: ok {rc=0} 01:07:15.079591 --- ParallelTerminationStrategy: PID 22025 died... 01:07:15.098011 run iperf3-srv_10.42.42.10(pid=22025): Terminated {rc=256} 01:07:15.141718 --- ParallelTerminationStrategy: PID 22026 died... 01:07:15.160236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22026): Terminated: ok {rc=0} 01:07:15.203318 --- ParallelTerminationStrategy: PID 22027 died... 01:07:15.221917 run iperf3-srv_10.42.42.10(pid=22027): Terminated {rc=256} 01:07:15.265141 --- ParallelTerminationStrategy: PID 22028 died... 01:07:15.283527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22028): Terminated: ok {rc=0} 01:07:15.327072 --- ParallelTerminationStrategy: PID 22029 died... 01:07:15.345479 run iperf3-srv_10.42.42.10(pid=22029): Terminated {rc=256} 01:07:15.388477 --- ParallelTerminationStrategy: PID 22030 died... 01:07:15.406892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22030): Terminated: ok {rc=0} 01:07:15.450059 --- ParallelTerminationStrategy: PID 22031 died... 01:07:15.468477 run iperf3-srv_10.42.42.10(pid=22031): Terminated {rc=256} 01:07:15.511488 --- ParallelTerminationStrategy: PID 22034 died... 01:07:15.529989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22034): Terminated: ok {rc=0} 01:07:15.573285 --- ParallelTerminationStrategy: PID 22037 died... 01:07:15.591841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22037): Terminated: ok {rc=0} 01:07:15.635022 --- ParallelTerminationStrategy: PID 22040 died... 01:07:15.653549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22040): Terminated: ok {rc=0} 01:07:15.738415 bus /gobi_4: Setting Powered False 01:07:16.844699 bus /gobi_4: Setting Powered False 01:07:17.970597 bus /gobi_1: Setting Powered False 01:07:19.066430 bus /gobi_1: Setting Powered False 01:07:20.182912 bus /gobi_0: Setting Powered False 01:07:21.280346 bus /gobi_0: Setting Powered False 01:07:22.393999 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 01:07:23.496478 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:23.508579 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:07:23.561413 tst ping.py: using LAC 37483 01:07:23.680168 tst ping.py: using RAC 253 01:07:23.804413 tst ping.py: using CellId 37483 01:07:23.920013 tst ping.py: using BVCI 37484 01:07:24.027170 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:24.038556 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:24.049730 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:24.060763 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:24.071805 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:24.082900 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:24.094206 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:24.105362 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:07:24.220387 tst ping.py:19: start network... 01:07:24.417714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:07:24.875470 run create_hlr_db(pid=22042): Launched 01:07:24.997562 bus /gobi_6: Setting Powered False 01:07:26.057430 run create_hlr_db(pid=22042): Terminated: ok {rc=0} 01:07:26.472649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22044): Launched 01:07:26.768624 run osmo-hlr_10.42.42.2(pid=22045): Launched 01:07:26.881194 run osmo-stp_10.42.42.5: Starting osmo-stp 01:07:27.410257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22047): Launched 01:07:27.705544 run osmo-stp_10.42.42.5(pid=22048): Launched 01:07:27.819614 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:07:28.331672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22050): Launched 01:07:28.445164 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:07:28.695311 run patchelf(pid=22051): Launched 01:07:28.862179 run osmo-stp_10.42.42.5(pid=22048): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22048)] 01:07:28.987838 run osmo-stp_10.42.42.5(pid=22048): stdout: | (launched: 2022-12-14_01:07:27.650948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:29.115338 run osmo-stp_10.42.42.5(pid=22048): stderr: | [0;m[38;5;43m20221214010727819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010727819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010727819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010727819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010727820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010727820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010727820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:29.242717 run osmo-stp_10.42.42.5(pid=22048): stdout: | (launched: 2022-12-14_01:07:27.650948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:29.363972 run osmo-stp_10.42.42.5(pid=22048): stderr: | [0;m[38;5;43m20221214010727819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010727819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010727819 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010727819 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010727820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010727820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010727820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:29.507330 run patchelf(pid=22051): Terminating (SIGINT) 01:07:29.672941 run patchelf(pid=22051): Terminated: ok {rc=0} 01:07:29.792114 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22048): Process ended prematurely: osmo-stp_10.42.42.5(pid=22048) [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22048)] [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 01:07:29.801307 tst ping.py:22: Test FAILED (6.3 sec) 01:07:29.828477 run osmo-hlr_10.42.42.2(pid=22045): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22045)] 01:07:29.875539 run osmo-hlr_10.42.42.2(pid=22045): stdout: | (launched: 2022-12-14_01:07:26.713906) 01:07:29.924320 run osmo-hlr_10.42.42.2(pid=22045): stderr: | [0;m[1;31m20221214010726885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010726885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010726885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010726885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010726885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010726885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010726898 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010726908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010726908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010726908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:07:29.973546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22044): Terminating (SIGTERM) 01:07:30.012810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22047): Terminating (SIGTERM) 01:07:30.051863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22050): Terminating (SIGTERM) 01:07:30.091322 --- ParallelTerminationStrategy: PID 22044 died... 01:07:30.110625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22044): Terminated: ok {rc=0} 01:07:30.154082 --- ParallelTerminationStrategy: PID 22047 died... 01:07:30.172665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22047): Terminated: ok {rc=0} 01:07:30.215966 --- ParallelTerminationStrategy: PID 22050 died... 01:07:30.234969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22050): Terminated: ok {rc=0} 01:07:30.319921 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 01:07:31.411383 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:31.424529 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:07:31.480543 tst ping_idle_ping.py: using LAC 37484 01:07:31.610182 tst ping_idle_ping.py: using RAC 254 01:07:31.738463 tst ping_idle_ping.py: using CellId 37484 01:07:31.890506 tst ping_idle_ping.py: using BVCI 37485 01:07:32.035196 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:32.050216 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:32.063758 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:32.077740 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:32.091530 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:32.106331 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:32.121155 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:07:32.135770 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:07:32.267776 tst ping_idle_ping.py:24: start network... 01:07:32.470041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:07:32.932195 run create_hlr_db(pid=22052): Launched 01:07:33.054027 bus /gobi_6: Setting Powered False 01:07:34.113680 run create_hlr_db(pid=22052): Terminated: ok {rc=0} 01:07:34.531380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22054): Launched 01:07:34.829604 run osmo-hlr_10.42.42.2(pid=22055): Launched 01:07:34.942326 run osmo-stp_10.42.42.5: Starting osmo-stp 01:07:35.453971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22057): Launched 01:07:35.752306 run osmo-stp_10.42.42.5(pid=22058): Launched 01:07:35.865787 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:07:36.377494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22060): Launched 01:07:36.491038 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:07:36.742506 run patchelf(pid=22061): Launched 01:07:36.907491 run osmo-stp_10.42.42.5(pid=22058): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22058)] 01:07:37.032937 run osmo-stp_10.42.42.5(pid=22058): stdout: | (launched: 2022-12-14_01:07:35.696007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:37.159997 run osmo-stp_10.42.42.5(pid=22058): stderr: | [0;m[38;5;43m20221214010735863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010735863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010735864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010735864 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010735865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010735865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010735865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:37.287007 run osmo-stp_10.42.42.5(pid=22058): stdout: | (launched: 2022-12-14_01:07:35.696007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:37.408149 run osmo-stp_10.42.42.5(pid=22058): stderr: | [0;m[38;5;43m20221214010735863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010735863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010735864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010735864 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010735865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010735865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010735865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:37.551763 run patchelf(pid=22061): Terminating (SIGINT) 01:07:37.717591 run patchelf(pid=22061): Terminated: ok {rc=0} 01:07:37.836825 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22058): Process ended prematurely: osmo-stp_10.42.42.5(pid=22058) [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22058)] [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 01:07:37.845934 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 01:07:37.872726 run osmo-hlr_10.42.42.2(pid=22055): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22055)] 01:07:37.919632 run osmo-hlr_10.42.42.2(pid=22055): stdout: | (launched: 2022-12-14_01:07:34.774154) 01:07:37.968075 run osmo-hlr_10.42.42.2(pid=22055): stderr: | [0;m[1;31m20221214010734947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010734947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010734947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010734947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010734947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010734947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010734959 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010734969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010734970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010734970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:07:38.017028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22054): Terminating (SIGTERM) 01:07:38.056158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22057): Terminating (SIGTERM) 01:07:38.095279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22060): Terminating (SIGTERM) 01:07:38.134463 --- ParallelTerminationStrategy: PID 22054 died... 01:07:38.153412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22054): Terminated: ok {rc=0} 01:07:38.196455 --- ParallelTerminationStrategy: PID 22057 died... 01:07:38.214887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22057): Terminated: ok {rc=0} 01:07:38.257974 --- ParallelTerminationStrategy: PID 22060 died... 01:07:38.276400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22060): Terminated: ok {rc=0} 01:07:38.358935 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:07:39.676431 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:07:39.684210 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:07:39.720540 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:07:39.757078 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:07:39.811024 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:07:39.845306 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:07:39.881761 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:07:40.441474 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2397 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:07:40.447024 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:40.458941 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:07:40.531629 tst switch_tch_pdch.py: using LAC 37485 01:07:40.658216 tst switch_tch_pdch.py: using RAC 255 01:07:40.783977 tst switch_tch_pdch.py: using CellId 37485 01:07:40.908205 tst switch_tch_pdch.py: using BVCI 37486 01:07:41.024639 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:41.036419 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:41.047931 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:41.059433 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:41.071688 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:41.084034 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:41.096693 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:07:41.109231 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:07:41.227750 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:07:41.347090 tst switch_tch_pdch.py:51: start network... 01:07:41.563110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:07:42.058244 run create_hlr_db(pid=22065): Launched 01:07:42.181506 bus /gobi_6: Setting Powered False 01:07:43.244362 run create_hlr_db(pid=22065): Terminated: ok {rc=0} 01:07:43.672671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22067): Launched 01:07:43.970080 run osmo-hlr_10.42.42.2(pid=22068): Launched 01:07:44.082764 run osmo-stp_10.42.42.5: Starting osmo-stp 01:07:44.610354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22070): Launched 01:07:44.907327 run osmo-stp_10.42.42.5(pid=22071): Launched 01:07:45.021763 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:07:45.531632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22073): Launched 01:07:45.644695 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:07:45.920523 run patchelf(pid=22074): Launched 01:07:46.141096 run osmo-stp_10.42.42.5(pid=22071): ERR: Terminated: ERROR {rc=1} [trial-2397↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22071)] 01:07:46.279864 run osmo-stp_10.42.42.5(pid=22071): stdout: | (launched: 2022-12-14_01:07:44.852487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:46.422356 run osmo-stp_10.42.42.5(pid=22071): stderr: | [0;m[38;5;43m20221214010745019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010745019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010745019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010745020 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010745020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010745020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010745020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:46.564532 run osmo-stp_10.42.42.5(pid=22071): stdout: | (launched: 2022-12-14_01:07:44.852487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:46.699885 run osmo-stp_10.42.42.5(pid=22071): stderr: | [0;m[38;5;43m20221214010745019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010745019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010745019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010745020 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010745020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010745020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010745020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:46.862767 run patchelf(pid=22074): Terminating (SIGINT) 01:07:47.047036 run patchelf(pid=22074): Terminated: ok {rc=0} 01:07:47.180828 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22071): Process ended prematurely: osmo-stp_10.42.42.5(pid=22071) [trial-2397↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22071)] [trial-2397↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:07:47.190863 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 01:07:47.219531 run osmo-hlr_10.42.42.2(pid=22068): ERR: Terminated: ERROR {rc=237} [trial-2397↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22068)] 01:07:47.271118 run osmo-hlr_10.42.42.2(pid=22068): stdout: | (launched: 2022-12-14_01:07:43.915099) 01:07:47.323662 run osmo-hlr_10.42.42.2(pid=22068): stderr: | [0;m[1;31m20221214010744085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010744085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010744085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010744086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010744086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010744086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010744098 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010744106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010744106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010744106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:07:47.376741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22067): Terminating (SIGTERM) 01:07:47.418829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22070): Terminating (SIGTERM) 01:07:47.461773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22073): Terminating (SIGTERM) 01:07:47.504645 --- ParallelTerminationStrategy: PID 22067 died... 01:07:47.525390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22067): Terminated: ok {rc=0} 01:07:47.572149 --- ParallelTerminationStrategy: PID 22070 died... 01:07:47.592377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22070): Terminated: ok {rc=0} 01:07:47.638788 --- ParallelTerminationStrategy: PID 22073 died... 01:07:47.658969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22073): Terminated: ok {rc=0} 01:07:47.748664 bus /gobi_0: Setting Powered False 01:07:48.847063 bus /gobi_0: Setting Powered False 01:07:49.962973 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 01:07:51.218315 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:07:51.224564 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 01:07:51.259435 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 01:07:51.295693 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 01:07:51.351048 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 01:07:51.384027 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 01:07:51.417935 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 01:07:51.973228 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2397 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 01:07:51.978832 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:07:51.989918 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 01:07:52.068520 tst switch_tch_pdch.py: using LAC 37486 01:07:52.186304 tst switch_tch_pdch.py: using RAC 1 01:07:52.302531 tst switch_tch_pdch.py: using CellId 37486 01:07:52.417725 tst switch_tch_pdch.py: using BVCI 37487 01:07:52.524011 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:07:52.534995 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:07:52.545743 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:07:52.556389 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:07:52.567173 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:07:52.577962 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:07:52.589070 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:07:52.599721 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:07:52.719962 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:07:52.840849 tst switch_tch_pdch.py:51: start network... 01:07:53.055162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:07:53.519333 run create_hlr_db(pid=22078): Launched 01:07:53.641863 bus /gobi_6: Setting Powered False 01:07:54.704645 run create_hlr_db(pid=22078): Terminated: ok {rc=0} 01:07:55.106287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22080): Launched 01:07:55.402467 run osmo-hlr_10.42.42.2(pid=22081): Launched 01:07:55.515015 run osmo-stp_10.42.42.5: Starting osmo-stp 01:07:56.013541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22083): Launched 01:07:56.311019 run osmo-stp_10.42.42.5(pid=22084): Launched 01:07:56.423154 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:07:56.907865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22086): Launched 01:07:57.020496 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:07:57.269283 run patchelf(pid=22087): Launched 01:07:57.433515 run osmo-stp_10.42.42.5(pid=22084): ERR: Terminated: ERROR {rc=1} [trial-2397↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22084)] 01:07:57.558733 run osmo-stp_10.42.42.5(pid=22084): stdout: | (launched: 2022-12-14_01:07:56.256342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:57.685496 run osmo-stp_10.42.42.5(pid=22084): stderr: | [0;m[38;5;43m20221214010756422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010756422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010756423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010756423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010756424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010756424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010756424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:57.812665 run osmo-stp_10.42.42.5(pid=22084): stdout: | (launched: 2022-12-14_01:07:56.256342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:07:57.933549 run osmo-stp_10.42.42.5(pid=22084): stderr: | [0;m[38;5;43m20221214010756422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010756422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010756423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010756423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010756424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010756424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010756424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:07:58.077380 run patchelf(pid=22087): Terminating (SIGINT) 01:07:58.242565 run patchelf(pid=22087): Terminated: ok {rc=0} 01:07:58.361766 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22084): Process ended prematurely: osmo-stp_10.42.42.5(pid=22084) [trial-2397↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22084)] [trial-2397↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 01:07:58.370590 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 01:07:58.396689 run osmo-hlr_10.42.42.2(pid=22081): ERR: Terminated: ERROR {rc=237} [trial-2397↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22081)] 01:07:58.443669 run osmo-hlr_10.42.42.2(pid=22081): stdout: | (launched: 2022-12-14_01:07:55.347892) 01:07:58.492087 run osmo-hlr_10.42.42.2(pid=22081): stderr: | [0;m[1;31m20221214010755517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010755517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010755517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010755517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010755517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010755517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010755529 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010755539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010755539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010755539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:07:58.540942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22080): Terminating (SIGTERM) 01:07:58.580015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22083): Terminating (SIGTERM) 01:07:58.618871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22086): Terminating (SIGTERM) 01:07:58.658199 --- ParallelTerminationStrategy: PID 22080 died... 01:07:58.677426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22080): Terminated: ok {rc=0} 01:07:58.721064 --- ParallelTerminationStrategy: PID 22083 died... 01:07:58.739572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22083): Terminated: ok {rc=0} 01:07:58.782869 --- ParallelTerminationStrategy: PID 22086 died... 01:07:58.801354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22086): Terminated: ok {rc=0} 01:07:58.883522 bus /gobi_0: Setting Powered False 01:07:59.977553 bus /gobi_0: Setting Powered False 01:08:01.096471 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 01:08:02.364032 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:08:02.369350 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 01:08:02.404879 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 01:08:02.412204 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 01:08:02.465671 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 01:08:02.499799 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 01:08:02.507065 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 01:08:03.045577 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 01:08:03.050875 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 01:08:03.062418 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:08:03.111924 tst mo_mt_sms.py: using LAC 37487 01:08:03.236302 tst mo_mt_sms.py: using RAC 2 01:08:03.361039 tst mo_mt_sms.py: using CellId 37487 01:08:03.485437 tst mo_mt_sms.py: using BVCI 37488 01:08:03.602561 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 01:08:03.718132 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 01:08:03.834678 tst mo_mt_sms.py:9: start nitb and bts... 01:08:04.051100 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:08:04.699424 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22091): Launched 01:08:05.020213 run osmo-nitb_10.42.42.2(pid=22092): Launched 01:08:05.198006 run osmo-nitb_10.42.42.2(pid=22092): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22092)] 01:08:05.341915 run osmo-nitb_10.42.42.2(pid=22092): stdout: | (launched: 2022-12-14_01:08:04.962234) 01:08:05.487069 run osmo-nitb_10.42.42.2(pid=22092): stderr: | (launched: 2022-12-14_01:08:05.009443) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:08:05.631842 run osmo-nitb_10.42.42.2(pid=22092): stdout: | (launched: 2022-12-14_01:08:04.962234) 01:08:05.771134 run osmo-nitb_10.42.42.2(pid=22092): stderr: | (launched: 2022-12-14_01:08:05.009443) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8b7301f268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22092): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22092) [trial-2397↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22092)] 01:08:06.141636 tst osmo-nitb_10.42.42.2(pid=22092): stdout: | (launched: 2022-12-14_01:08:04.962234) 01:08:06.270364 tst osmo-nitb_10.42.42.2(pid=22092): stderr: | (launched: 2022-12-14_01:08:05.009443) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:08:06.422672 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=22092): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22092) [trial-2397↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22092)] [trial-2397↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 01:08:06.431923 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 01:08:06.439131 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22091): Terminating (SIGTERM) 01:08:06.651661 --- ParallelTerminationStrategy: PID 22091 died... 01:08:06.673340 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22091): Terminated: ok {rc=0} 01:08:06.762871 bus /sierra_3: Setting Powered False 01:08:07.863465 bus /sierra_3: Setting Powered False 01:08:08.982624 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 sms:trx-sysmocell5000 --------------------------------------------------------------------- 01:08:10.185755 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:08:10.190309 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 01:08:10.225262 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 01:08:10.254313 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 01:08:10.309496 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 01:08:10.344606 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 01:08:10.372120 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 01:08:10.918748 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 01:08:10.924243 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:10.935477 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:08:10.985113 tst mo_mt_sms.py: using LAC 37488 01:08:11.109699 tst mo_mt_sms.py: using RAC 3 01:08:11.236225 tst mo_mt_sms.py: using CellId 37488 01:08:11.360783 tst mo_mt_sms.py: using BVCI 37489 01:08:11.476635 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:11.487869 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:11.498996 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:11.509979 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:11.521432 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:11.532730 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 01:08:11.647559 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 01:08:11.766992 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:08:12.261998 run create_hlr_db(pid=22098): Launched 01:08:12.384414 bus /sierra_2: Setting Powered False 01:08:13.447952 run create_hlr_db(pid=22098): Terminated: ok {rc=0} 01:08:13.875982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22100): Launched 01:08:14.174667 run osmo-hlr_10.42.42.2(pid=22101): Launched 01:08:14.287628 run osmo-stp_10.42.42.5: Starting osmo-stp 01:08:14.797493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22103): Launched 01:08:15.094916 run osmo-stp_10.42.42.5(pid=22104): Launched 01:08:15.207345 run osmo-msc_10.42.42.6: Starting osmo-msc 01:08:15.742840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22106): Launched 01:08:16.068498 run osmo-msc_10.42.42.6(pid=22107): Launched 01:08:16.262855 run osmo-stp_10.42.42.5(pid=22104): ERR: Terminated: ERROR {rc=1} [trial-2397↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22104)] 01:08:16.421242 run osmo-stp_10.42.42.5(pid=22104): stdout: | (launched: 2022-12-14_01:08:15.039902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:16.616408 run osmo-stp_10.42.42.5(pid=22104): stderr: | [0;m[38;5;43m20221214010815204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010815204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010815205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010815205 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010815206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010815206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010815206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:16.926899 run osmo-stp_10.42.42.5(pid=22104): stdout: | (launched: 2022-12-14_01:08:15.039902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:17.047237 run osmo-stp_10.42.42.5(pid=22104): stderr: | [0;m[38;5;43m20221214010815204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010815204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010815205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010815205 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010815206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010815206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010815206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:17.207733 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=22104): Process ended prematurely: osmo-stp_10.42.42.5(pid=22104) [trial-2397↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22104)] [trial-2397↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 01:08:17.217467 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 01:08:17.245770 run osmo-hlr_10.42.42.2(pid=22101): ERR: Terminated: ERROR {rc=237} [trial-2397↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22101)] 01:08:17.299207 run osmo-hlr_10.42.42.2(pid=22101): stdout: | (launched: 2022-12-14_01:08:14.118826) 01:08:17.354986 run osmo-hlr_10.42.42.2(pid=22101): stderr: | [0;m[1;31m20221214010814288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010814288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010814288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010814288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010814289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010814289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010814300 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010814311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010814311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010814311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:08:17.430388 run osmo-msc_10.42.42.6(pid=22107): ERR: Terminated: ERROR {rc=2} [trial-2397↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22107)] 01:08:17.483347 run osmo-msc_10.42.42.6(pid=22107): stdout: | (launched: 2022-12-14_01:08:16.011924) 01:08:17.534757 run osmo-msc_10.42.42.6(pid=22107): stderr: | [0;m[38;5;43m20221214010816668 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010816668 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9a5cc4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010816670 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010816670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010816671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010816671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010816678 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010816680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010816681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010816681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:08:17.587323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22100): Terminating (SIGTERM) 01:08:17.629317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22103): Terminating (SIGTERM) 01:08:17.671622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22106): Terminating (SIGTERM) 01:08:17.713752 --- ParallelTerminationStrategy: PID 22100 died... 01:08:17.734483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22100): Terminated: ok {rc=0} 01:08:17.781077 --- ParallelTerminationStrategy: PID 22103 died... 01:08:17.800875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22103): Terminated: ok {rc=0} 01:08:17.846981 --- ParallelTerminationStrategy: PID 22106 died... 01:08:17.866779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22106): Terminated: ok {rc=0} 01:08:17.954210 bus /sierra_3: Setting Powered False 01:08:19.052410 bus /sierra_3: Setting Powered False 01:08:20.169503 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 01:08:21.399161 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:08:21.402851 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 01:08:21.436941 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 01:08:21.443953 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 01:08:21.479064 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 01:08:21.512520 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 01:08:21.519175 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 01:08:22.039681 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2397 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 01:08:22.044464 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 01:08:22.055389 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:08:22.102658 tst assert_extension.py: using LAC 37489 01:08:22.218541 tst assert_extension.py: using RAC 4 01:08:22.336541 tst assert_extension.py: using CellId 37489 01:08:22.452679 tst assert_extension.py: using BVCI 37490 01:08:22.570966 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 01:08:22.685830 tst assert_extension.py:10: start nitb and bts... 01:08:22.883319 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:08:23.489296 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22112): Launched 01:08:23.786030 run osmo-nitb_10.42.42.2(pid=22113): Launched 01:08:23.950425 run osmo-nitb_10.42.42.2(pid=22113): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22113)] 01:08:24.082988 run osmo-nitb_10.42.42.2(pid=22113): stdout: | (launched: 2022-12-14_01:08:23.730756) 01:08:24.217896 run osmo-nitb_10.42.42.2(pid=22113): stderr: | (launched: 2022-12-14_01:08:23.774548) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:08:24.353141 run osmo-nitb_10.42.42.2(pid=22113): stdout: | (launched: 2022-12-14_01:08:23.730756) 01:08:24.482013 run osmo-nitb_10.42.42.2(pid=22113): stderr: | (launched: 2022-12-14_01:08:23.774548) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8b7301f268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22113): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22113) [trial-2397↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22113)] 01:08:24.897519 tst osmo-nitb_10.42.42.2(pid=22113): stdout: | (launched: 2022-12-14_01:08:23.730756) 01:08:25.017321 tst osmo-nitb_10.42.42.2(pid=22113): stderr: | (launched: 2022-12-14_01:08:23.774548) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:08:25.158225 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=22113): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22113) [trial-2397↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22113)] [trial-2397↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 01:08:25.166614 tst assert_extension.py:12: Test FAILED (3.1 sec) 01:08:25.173262 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22112): Terminating (SIGTERM) 01:08:25.381874 --- ParallelTerminationStrategy: PID 22112 died... 01:08:25.402920 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22112): Terminated: ok {rc=0} 01:08:25.488497 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 01:08:26.667582 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:08:26.671450 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 01:08:26.704638 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 01:08:26.731222 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 01:08:26.766607 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 01:08:26.800262 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 01:08:26.826613 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 01:08:27.359770 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2397 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 01:08:27.364880 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:27.376099 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:08:27.423204 tst assert_extension.py: using LAC 37490 01:08:27.539701 tst assert_extension.py: using RAC 5 01:08:27.656371 tst assert_extension.py: using CellId 37490 01:08:27.773452 tst assert_extension.py: using BVCI 37491 01:08:27.880655 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:27.891470 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:27.902143 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:27.912625 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:27.923136 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:08:27.933676 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 01:08:28.051240 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:08:28.512584 run create_hlr_db(pid=22117): Launched 01:08:28.635051 bus /sierra_2: Setting Powered False 01:08:29.694737 run create_hlr_db(pid=22117): Terminated: ok {rc=0} 01:08:30.132691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22119): Launched 01:08:30.453566 run osmo-hlr_10.42.42.2(pid=22120): Launched 01:08:30.576194 run osmo-stp_10.42.42.5: Starting osmo-stp 01:08:31.242630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22122): Launched 01:08:31.591673 run osmo-stp_10.42.42.5(pid=22123): Launched 01:08:31.784567 run osmo-msc_10.42.42.6: Starting osmo-msc 01:08:32.387378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22125): Launched 01:08:32.679945 run osmo-msc_10.42.42.6(pid=22126): Launched 01:08:32.842817 run osmo-stp_10.42.42.5(pid=22123): ERR: Terminated: ERROR {rc=1} [trial-2397↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22123)] 01:08:32.965638 run osmo-stp_10.42.42.5(pid=22123): stdout: | (launched: 2022-12-14_01:08:31.531554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:33.089189 run osmo-stp_10.42.42.5(pid=22123): stderr: | [0;m[38;5;43m20221214010831770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010831770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010831770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010831771 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010831772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010831772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010831772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:33.211147 run osmo-stp_10.42.42.5(pid=22123): stdout: | (launched: 2022-12-14_01:08:31.531554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:33.327639 run osmo-stp_10.42.42.5(pid=22123): stderr: | [0;m[38;5;43m20221214010831770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010831770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010831770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010831771 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010831772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010831772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010831772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:33.467448 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=22123): Process ended prematurely: osmo-stp_10.42.42.5(pid=22123) [trial-2397↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22123)] [trial-2397↪ussd:trx-sysmocell5000↪assert_extension.py:17] 01:08:33.475704 tst assert_extension.py:17: Test FAILED (6.1 sec) 01:08:33.501258 run osmo-hlr_10.42.42.2(pid=22120): ERR: Terminated: ERROR {rc=237} [trial-2397↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22120)] 01:08:33.548249 run osmo-hlr_10.42.42.2(pid=22120): stdout: | (launched: 2022-12-14_01:08:30.395214) 01:08:33.596904 run osmo-hlr_10.42.42.2(pid=22120): stderr: | [0;m[1;31m20221214010830588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010830588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010830588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010830588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010830588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010830588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010830601 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010830609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010830610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010830610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:08:33.664655 run osmo-msc_10.42.42.6(pid=22126): ERR: Terminated: ERROR {rc=2} [trial-2397↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22126)] 01:08:33.711642 run osmo-msc_10.42.42.6(pid=22126): stdout: | (launched: 2022-12-14_01:08:32.625805) 01:08:33.760122 run osmo-msc_10.42.42.6(pid=22126): stderr: | [0;m[38;5;43m20221214010832895 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010832895 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcc58812c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010832896 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010832896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010832896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010832896 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010832898 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010832898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010832898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010832898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:08:33.809331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22119): Terminating (SIGTERM) 01:08:33.848486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22122): Terminating (SIGTERM) 01:08:33.887680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22125): Terminating (SIGTERM) 01:08:33.927025 --- ParallelTerminationStrategy: PID 22119 died... 01:08:33.945814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22119): Terminated: ok {rc=0} 01:08:33.988642 --- ParallelTerminationStrategy: PID 22122 died... 01:08:34.006765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22122): Terminated: ok {rc=0} 01:08:34.049397 --- ParallelTerminationStrategy: PID 22125 died... 01:08:34.067526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22125): Terminated: ok {rc=0} 01:08:34.152330 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 01:08:35.365319 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:08:35.371983 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 01:08:35.404930 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 01:08:35.431426 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 01:08:35.481903 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 01:08:35.515539 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 01:08:35.542121 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 01:08:36.097529 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 01:08:36.150454 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:36.162199 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:08:36.233536 tst mo_mt_call.py: using LAC 37491 01:08:36.360630 tst mo_mt_call.py: using RAC 6 01:08:36.485831 tst mo_mt_call.py: using CellId 37491 01:08:36.617824 tst mo_mt_call.py: using BVCI 37492 01:08:36.736101 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:36.747797 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:36.759304 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:36.770843 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:36.782783 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:36.794679 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:08:36.912074 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:08:37.025347 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:08:37.490866 run create_hlr_db(pid=22131): Launched 01:08:37.615688 bus /sierra_2: Setting Powered False 01:08:38.675235 run create_hlr_db(pid=22131): Terminated: ok {rc=0} 01:08:39.114459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22133): Launched 01:08:39.435460 run osmo-hlr_10.42.42.2(pid=22134): Launched 01:08:39.558214 run osmo-stp_10.42.42.5: Starting osmo-stp 01:08:40.113726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22136): Launched 01:08:40.434880 run osmo-stp_10.42.42.5(pid=22137): Launched 01:08:40.558734 run osmo-msc_10.42.42.6: Starting osmo-msc 01:08:41.139808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22139): Launched 01:08:41.461343 run osmo-msc_10.42.42.6(pid=22140): Launched 01:08:41.641781 run osmo-stp_10.42.42.5(pid=22137): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22137)] 01:08:41.778430 run osmo-stp_10.42.42.5(pid=22137): stdout: | (launched: 2022-12-14_01:08:40.376307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:41.915406 run osmo-stp_10.42.42.5(pid=22137): stderr: | [0;m[38;5;43m20221214010840563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010840563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010840564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010840564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010840565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010840565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010840565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:42.049774 run osmo-stp_10.42.42.5(pid=22137): stdout: | (launched: 2022-12-14_01:08:40.376307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:42.178006 run osmo-stp_10.42.42.5(pid=22137): stderr: | [0;m[38;5;43m20221214010840563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010840563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010840564 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010840564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010840565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010840565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010840565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:42.331719 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22137): Process ended prematurely: osmo-stp_10.42.42.5(pid=22137) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22137)] [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 01:08:42.341660 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 01:08:42.369332 run osmo-hlr_10.42.42.2(pid=22134): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22134)] 01:08:42.419852 run osmo-hlr_10.42.42.2(pid=22134): stdout: | (launched: 2022-12-14_01:08:39.377207) 01:08:42.472032 run osmo-hlr_10.42.42.2(pid=22134): stderr: | [0;m[1;31m20221214010839571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010839571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010839571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010839571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010839571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010839571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010839583 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010839591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010839591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010839591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:08:42.544000 run osmo-msc_10.42.42.6(pid=22140): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22140)] 01:08:42.593694 run osmo-msc_10.42.42.6(pid=22140): stdout: | (launched: 2022-12-14_01:08:41.402673) 01:08:42.645480 run osmo-msc_10.42.42.6(pid=22140): stderr: | [0;m[38;5;43m20221214010841719 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010841719 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3e72419c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010841719 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010841719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010841719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010841720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010841721 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010841722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010841722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010841722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:08:42.697562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22133): Terminating (SIGTERM) 01:08:42.739142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22136): Terminating (SIGTERM) 01:08:42.781077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22139): Terminating (SIGTERM) 01:08:42.823245 --- ParallelTerminationStrategy: PID 22133 died... 01:08:42.843416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22133): Terminated: ok {rc=0} 01:08:42.889598 --- ParallelTerminationStrategy: PID 22136 died... 01:08:42.909381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22136): Terminated: ok {rc=0} 01:08:42.955188 --- ParallelTerminationStrategy: PID 22139 died... 01:08:42.974996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22139): Terminated: ok {rc=0} 01:08:43.061974 bus /sierra_3: Setting Powered False 01:08:44.160645 bus /sierra_3: Setting Powered False 01:08:45.276932 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 01:08:46.438699 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:46.452046 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:08:46.526746 tst mo_mt_call_osmux.py: using LAC 37492 01:08:46.690129 tst mo_mt_call_osmux.py: using RAC 7 01:08:46.815936 tst mo_mt_call_osmux.py: using CellId 37492 01:08:46.971224 tst mo_mt_call_osmux.py: using BVCI 37493 01:08:47.131367 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:47.149164 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:47.164339 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:47.179870 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:47.197630 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:08:47.211562 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:08:47.336693 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:08:47.454622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:08:47.921227 run create_hlr_db(pid=22142): Launched 01:08:48.044613 bus /sierra_2: Setting Powered False 01:08:49.105348 run create_hlr_db(pid=22142): Terminated: ok {rc=0} 01:08:49.525626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22144): Launched 01:08:49.828318 run osmo-hlr_10.42.42.2(pid=22145): Launched 01:08:49.941659 run osmo-stp_10.42.42.5: Starting osmo-stp 01:08:50.455858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22147): Launched 01:08:50.759439 run osmo-stp_10.42.42.5(pid=22148): Launched 01:08:50.873842 run osmo-msc_10.42.42.6: Starting osmo-msc 01:08:51.416199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22150): Launched 01:08:51.717575 run osmo-msc_10.42.42.6(pid=22151): Launched 01:08:51.885866 run osmo-stp_10.42.42.5(pid=22148): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22148)] 01:08:52.012900 run osmo-stp_10.42.42.5(pid=22148): stdout: | (launched: 2022-12-14_01:08:50.703154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:52.140412 run osmo-stp_10.42.42.5(pid=22148): stderr: | [0;m[38;5;43m20221214010850870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010850870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010850870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010850871 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010850871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010850871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010850871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:52.265829 run osmo-stp_10.42.42.5(pid=22148): stdout: | (launched: 2022-12-14_01:08:50.703154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:08:52.385233 run osmo-stp_10.42.42.5(pid=22148): stderr: | [0;m[38;5;43m20221214010850870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010850870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010850870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010850871 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010850871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010850871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010850871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:08:52.529336 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22148): Process ended prematurely: osmo-stp_10.42.42.5(pid=22148) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22148)] [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 01:08:52.538327 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:08:52.564234 run osmo-hlr_10.42.42.2(pid=22145): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22145)] 01:08:52.611432 run osmo-hlr_10.42.42.2(pid=22145): stdout: | (launched: 2022-12-14_01:08:49.772340) 01:08:52.659963 run osmo-hlr_10.42.42.2(pid=22145): stderr: | [0;m[1;31m20221214010849946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010849946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010849946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010849946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010849946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010849946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010849965 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010849974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010849974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010849974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:08:52.727799 run osmo-msc_10.42.42.6(pid=22151): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22151)] 01:08:52.775098 run osmo-msc_10.42.42.6(pid=22151): stdout: | (launched: 2022-12-14_01:08:51.661703) 01:08:52.823411 run osmo-msc_10.42.42.6(pid=22151): stderr: | [0;m[38;5;43m20221214010851930 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010851931 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5ee9943c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010851931 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010851931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010851931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010851931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010851933 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010851933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010851933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010851933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:08:52.872009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22144): Terminating (SIGTERM) 01:08:52.910939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22147): Terminating (SIGTERM) 01:08:52.949882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22150): Terminating (SIGTERM) 01:08:52.989165 --- ParallelTerminationStrategy: PID 22144 died... 01:08:53.007996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22144): Terminated: ok {rc=0} 01:08:53.051113 --- ParallelTerminationStrategy: PID 22147 died... 01:08:53.069430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22147): Terminated: ok {rc=0} 01:08:53.112352 --- ParallelTerminationStrategy: PID 22150 died... 01:08:53.130658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22150): Terminated: ok {rc=0} 01:08:53.215545 bus /sierra_3: Setting Powered False 01:08:54.314622 bus /sierra_3: Setting Powered False 01:08:55.429209 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 01:08:56.680304 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:08:56.686987 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 01:08:56.719827 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 01:08:56.746224 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 01:08:56.797294 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 01:08:56.830362 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 01:08:56.856488 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 01:08:57.409219 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 01:08:57.457168 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:08:57.468377 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:08:57.536401 tst mo_mt_call.py: using LAC 37493 01:08:57.653752 tst mo_mt_call.py: using RAC 8 01:08:57.771281 tst mo_mt_call.py: using CellId 37493 01:08:57.890683 tst mo_mt_call.py: using BVCI 37494 01:08:58.000660 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:08:58.011857 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:08:58.022870 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:08:58.033823 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:08:58.044808 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:08:58.055782 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:08:58.175252 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:08:58.291272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:08:58.754717 run create_hlr_db(pid=22156): Launched 01:08:58.881071 bus /sierra_2: Setting Powered False 01:08:59.941194 run create_hlr_db(pid=22156): Terminated: ok {rc=0} 01:09:00.380714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22158): Launched 01:09:00.701782 run osmo-hlr_10.42.42.2(pid=22159): Launched 01:09:00.825621 run osmo-stp_10.42.42.5: Starting osmo-stp 01:09:01.531953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22184): Launched 01:09:01.901865 run osmo-stp_10.42.42.5(pid=22198): Launched 01:09:02.069285 run osmo-msc_10.42.42.6: Starting osmo-msc 01:09:02.850644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22224): Launched 01:09:03.251103 run osmo-msc_10.42.42.6(pid=22243): Launched 01:09:03.675647 run osmo-stp_10.42.42.5(pid=22198): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22198)] 01:09:04.025172 run osmo-stp_10.42.42.5(pid=22198): stdout: | (launched: 2022-12-14_01:09:01.841842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:04.242121 run osmo-stp_10.42.42.5(pid=22198): stderr: | [0;m[38;5;43m20221214010902199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010902199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010902200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010902200 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010902200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010902206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010902207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:04.409796 run osmo-stp_10.42.42.5(pid=22198): stdout: | (launched: 2022-12-14_01:09:01.841842) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:04.574184 run osmo-stp_10.42.42.5(pid=22198): stderr: | [0;m[38;5;43m20221214010902199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010902199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010902200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010902200 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010902200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010902206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010902207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:04.765443 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22198): Process ended prematurely: osmo-stp_10.42.42.5(pid=22198) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22198)] [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 01:09:04.777641 tst mo_mt_call.py:8: Test FAILED (7.4 sec) 01:09:04.811040 run osmo-hlr_10.42.42.2(pid=22159): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22159)] 01:09:04.872563 run osmo-hlr_10.42.42.2(pid=22159): stdout: | (launched: 2022-12-14_01:09:00.643362) 01:09:04.932679 run osmo-hlr_10.42.42.2(pid=22159): stderr: | [0;m[1;31m20221214010900864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010900864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010900864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010900864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010900864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010900864 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010900887 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010900899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010900900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010900900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:09:05.007012 run osmo-msc_10.42.42.6(pid=22243): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22243)] 01:09:05.061899 run osmo-msc_10.42.42.6(pid=22243): stdout: | (launched: 2022-12-14_01:09:03.186255) 01:09:05.117351 run osmo-msc_10.42.42.6(pid=22243): stderr: | [0;m[38;5;43m20221214010903747 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010903747 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9c34c04c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010903747 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010903747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010903747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010903748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010903755 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010903755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010903755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010903755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:09:05.172041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22158): Terminating (SIGTERM) 01:09:05.215140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22184): Terminating (SIGTERM) 01:09:05.260731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22224): Terminating (SIGTERM) 01:09:05.307018 --- ParallelTerminationStrategy: PID 22158 died... 01:09:05.328898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22158): Terminated: ok {rc=0} 01:09:05.378248 --- ParallelTerminationStrategy: PID 22184 died... 01:09:05.399331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22184): Terminated: ok {rc=0} 01:09:05.447463 --- ParallelTerminationStrategy: PID 22224 died... 01:09:05.469217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22224): Terminated: ok {rc=0} 01:09:05.561046 bus /sierra_3: Setting Powered False 01:09:06.663893 bus /sierra_3: Setting Powered False 01:09:07.784795 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 01:09:08.930465 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:09:08.943534 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:09:09.017214 tst mo_mt_call_osmux.py: using LAC 37494 01:09:09.136012 tst mo_mt_call_osmux.py: using RAC 9 01:09:09.257650 tst mo_mt_call_osmux.py: using CellId 37494 01:09:09.379626 tst mo_mt_call_osmux.py: using BVCI 37495 01:09:09.490884 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:09:09.503117 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:09:09.515133 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:09:09.527377 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:09:09.539968 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:09:09.552314 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:09:09.672729 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:09:09.793043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:09:10.275546 run create_hlr_db(pid=22439): Launched 01:09:10.436752 bus /sierra_2: Setting Powered False 01:09:11.497946 run create_hlr_db(pid=22439): Terminated: ok {rc=0} 01:09:11.930470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22441): Launched 01:09:12.252131 run osmo-hlr_10.42.42.2(pid=22442): Launched 01:09:12.486037 run osmo-stp_10.42.42.5: Starting osmo-stp 01:09:13.191303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22444): Launched 01:09:13.512469 run osmo-stp_10.42.42.5(pid=22445): Launched 01:09:13.743961 run osmo-msc_10.42.42.6: Starting osmo-msc 01:09:14.456737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22447): Launched 01:09:14.782513 run osmo-msc_10.42.42.6(pid=22448): Launched 01:09:15.127083 run osmo-stp_10.42.42.5(pid=22445): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22445)] 01:09:15.405206 run osmo-stp_10.42.42.5(pid=22445): stdout: | (launched: 2022-12-14_01:09:13.455764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:15.671010 run osmo-stp_10.42.42.5(pid=22445): stderr: | [0;m[38;5;43m20221214010913775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010913775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010913776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010913776 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010913777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010913777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010913777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:15.841601 run osmo-stp_10.42.42.5(pid=22445): stdout: | (launched: 2022-12-14_01:09:13.455764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:16.011302 run osmo-stp_10.42.42.5(pid=22445): stderr: | [0;m[38;5;43m20221214010913775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010913775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010913776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010913776 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010913777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010913777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010913777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:16.168697 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22445): Process ended prematurely: osmo-stp_10.42.42.5(pid=22445) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22445)] [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 01:09:16.178545 tst mo_mt_call_osmux.py:8: Test FAILED (7.3 sec) 01:09:16.205754 run osmo-hlr_10.42.42.2(pid=22442): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22442)] 01:09:16.254434 run osmo-hlr_10.42.42.2(pid=22442): stdout: | (launched: 2022-12-14_01:09:12.195414) 01:09:16.316932 run osmo-hlr_10.42.42.2(pid=22442): stderr: | [0;m[1;31m20221214010912531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010912531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010912531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010912531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010912531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010912531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010912547 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010912555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010912555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010912555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:09:16.428016 run osmo-msc_10.42.42.6(pid=22448): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22448)] 01:09:16.481751 run osmo-msc_10.42.42.6(pid=22448): stdout: | (launched: 2022-12-14_01:09:14.723228) 01:09:16.539432 run osmo-msc_10.42.42.6(pid=22448): stderr: | [0;m[38;5;43m20221214010915307 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010915307 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8bbd78ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010915307 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010915307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010915307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010915307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010915313 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010915313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010915314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010915314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:09:16.597713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22441): Terminating (SIGTERM) 01:09:16.645511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22444): Terminating (SIGTERM) 01:09:16.696080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22447): Terminating (SIGTERM) 01:09:16.745657 --- ParallelTerminationStrategy: PID 22441 died... 01:09:16.771467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22441): Terminated: ok {rc=0} 01:09:16.824227 --- ParallelTerminationStrategy: PID 22444 died... 01:09:16.846665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22444): Terminated: ok {rc=0} 01:09:16.899052 --- ParallelTerminationStrategy: PID 22447 died... 01:09:16.921728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22447): Terminated: ok {rc=0} 01:09:17.024150 bus /sierra_3: Setting Powered False 01:09:18.126484 bus /sierra_3: Setting Powered False 01:09:19.248279 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 01:09:20.512216 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:09:20.520581 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 01:09:20.559835 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 01:09:20.589743 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 01:09:20.644145 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 01:09:20.680715 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 01:09:20.710739 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 01:09:21.262198 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 01:09:21.318682 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:21.331506 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:09:21.408755 tst mo_mt_call.py: using LAC 37495 01:09:21.540629 tst mo_mt_call.py: using RAC 10 01:09:21.676223 tst mo_mt_call.py: using CellId 37495 01:09:21.806512 tst mo_mt_call.py: using BVCI 37496 01:09:21.928703 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:21.941962 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:21.955312 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:21.968993 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:21.983194 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:21.997014 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:09:22.126449 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:09:22.254571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:09:22.772719 run create_hlr_db(pid=22453): Launched 01:09:22.937666 bus /sierra_2: Setting Powered False 01:09:24.003863 run create_hlr_db(pid=22453): Terminated: ok {rc=0} 01:09:24.467389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22455): Launched 01:09:24.810445 run osmo-hlr_10.42.42.2(pid=22456): Launched 01:09:25.056072 run osmo-stp_10.42.42.5: Starting osmo-stp 01:09:25.730404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22458): Launched 01:09:26.080615 run osmo-stp_10.42.42.5(pid=22459): Launched 01:09:26.230024 run osmo-msc_10.42.42.6: Starting osmo-msc 01:09:26.824890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22462): Launched 01:09:27.155292 run osmo-msc_10.42.42.6(pid=22463): Launched 01:09:27.337058 run osmo-stp_10.42.42.5(pid=22459): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22459)] 01:09:27.474682 run osmo-stp_10.42.42.5(pid=22459): stdout: | (launched: 2022-12-14_01:09:26.020208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:27.613404 run osmo-stp_10.42.42.5(pid=22459): stderr: | [0;m[38;5;43m20221214010926221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010926221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010926221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010926222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010926222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010926222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010926222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:27.750456 run osmo-stp_10.42.42.5(pid=22459): stdout: | (launched: 2022-12-14_01:09:26.020208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:27.880940 run osmo-stp_10.42.42.5(pid=22459): stderr: | [0;m[38;5;43m20221214010926221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010926221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010926221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010926222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010926222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010926222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010926222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:28.036635 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22459): Process ended prematurely: osmo-stp_10.42.42.5(pid=22459) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22459)] [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 01:09:28.046429 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 01:09:28.074114 run osmo-hlr_10.42.42.2(pid=22456): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22456)] 01:09:28.124713 run osmo-hlr_10.42.42.2(pid=22456): stdout: | (launched: 2022-12-14_01:09:24.749725) 01:09:28.177352 run osmo-hlr_10.42.42.2(pid=22456): stderr: | [0;m[1;31m20221214010925059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010925059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010925059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010925059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010925059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010925059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010925074 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010925086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010925087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010925087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:09:28.249711 run osmo-msc_10.42.42.6(pid=22463): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22463)] 01:09:28.299607 run osmo-msc_10.42.42.6(pid=22463): stdout: | (launched: 2022-12-14_01:09:27.095286) 01:09:28.352116 run osmo-msc_10.42.42.6(pid=22463): stderr: | [0;m[38;5;43m20221214010927416 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010927416 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa838b9cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010927416 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010927416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010927416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010927416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010927418 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010927418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010927419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010927419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:09:28.404411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22455): Terminating (SIGTERM) 01:09:28.446156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22458): Terminating (SIGTERM) 01:09:28.488167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22462): Terminating (SIGTERM) 01:09:28.530569 --- ParallelTerminationStrategy: PID 22455 died... 01:09:28.550894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22455): Terminated: ok {rc=0} 01:09:28.597532 --- ParallelTerminationStrategy: PID 22458 died... 01:09:28.617779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22458): Terminated: ok {rc=0} 01:09:28.664113 --- ParallelTerminationStrategy: PID 22462 died... 01:09:28.683907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22462): Terminated: ok {rc=0} 01:09:28.772444 bus /sierra_3: Setting Powered False 01:09:29.871642 bus /sierra_3: Setting Powered False 01:09:31.001998 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 01:09:32.152932 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:32.166836 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:09:32.242161 tst mo_mt_call_osmux.py: using LAC 37496 01:09:32.370797 tst mo_mt_call_osmux.py: using RAC 11 01:09:32.498475 tst mo_mt_call_osmux.py: using CellId 37496 01:09:32.628192 tst mo_mt_call_osmux.py: using BVCI 37497 01:09:32.746882 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:32.758842 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:32.770803 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:32.782469 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:32.794651 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:09:32.806637 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:09:32.925198 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:09:33.043461 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:09:33.518011 run create_hlr_db(pid=22466): Launched 01:09:33.646611 bus /sierra_2: Setting Powered False 01:09:34.706800 run create_hlr_db(pid=22466): Terminated: ok {rc=0} 01:09:35.154242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22468): Launched 01:09:35.460697 run osmo-hlr_10.42.42.2(pid=22469): Launched 01:09:35.576798 run osmo-stp_10.42.42.5: Starting osmo-stp 01:09:36.103388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22471): Launched 01:09:36.409676 run osmo-stp_10.42.42.5(pid=22472): Launched 01:09:36.525145 run osmo-msc_10.42.42.6: Starting osmo-msc 01:09:37.078280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22474): Launched 01:09:37.384584 run osmo-msc_10.42.42.6(pid=22475): Launched 01:09:37.556383 run osmo-stp_10.42.42.5(pid=22472): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22472)] 01:09:37.686391 run osmo-stp_10.42.42.5(pid=22472): stdout: | (launched: 2022-12-14_01:09:36.353314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:37.815605 run osmo-stp_10.42.42.5(pid=22472): stderr: | [0;m[38;5;43m20221214010936523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010936523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010936523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010936523 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010936524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010936524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010936524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:37.942540 run osmo-stp_10.42.42.5(pid=22472): stdout: | (launched: 2022-12-14_01:09:36.353314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:38.063764 run osmo-stp_10.42.42.5(pid=22472): stderr: | [0;m[38;5;43m20221214010936523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010936523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010936523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010936523 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010936524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010936524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010936524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:38.208442 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22472): Process ended prematurely: osmo-stp_10.42.42.5(pid=22472) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22472)] [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 01:09:38.217541 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:09:38.243789 run osmo-hlr_10.42.42.2(pid=22469): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22469)] 01:09:38.291461 run osmo-hlr_10.42.42.2(pid=22469): stdout: | (launched: 2022-12-14_01:09:35.404331) 01:09:38.340868 run osmo-hlr_10.42.42.2(pid=22469): stderr: | [0;m[1;31m20221214010935578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010935578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010935578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010935578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010935578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010935578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010935590 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010935598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010935599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010935599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:09:38.409971 run osmo-msc_10.42.42.6(pid=22475): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22475)] 01:09:38.457658 run osmo-msc_10.42.42.6(pid=22475): stdout: | (launched: 2022-12-14_01:09:37.327235) 01:09:38.507085 run osmo-msc_10.42.42.6(pid=22475): stderr: | [0;m[38;5;43m20221214010937597 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010937597 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fec6dd59c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010937597 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010937597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010937598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010937598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010937599 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010937600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010937600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010937600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:09:38.556903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22468): Terminating (SIGTERM) 01:09:38.596744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22471): Terminating (SIGTERM) 01:09:38.636309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22474): Terminating (SIGTERM) 01:09:38.676146 --- ParallelTerminationStrategy: PID 22468 died... 01:09:38.695255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22468): Terminated: ok {rc=0} 01:09:38.739024 --- ParallelTerminationStrategy: PID 22471 died... 01:09:38.757648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22471): Terminated: ok {rc=0} 01:09:38.801318 --- ParallelTerminationStrategy: PID 22474 died... 01:09:38.819842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22474): Terminated: ok {rc=0} 01:09:38.904277 bus /sierra_3: Setting Powered False 01:09:40.000386 bus /sierra_3: Setting Powered False 01:09:41.115597 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 01:09:42.366722 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:09:42.373443 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 01:09:42.406536 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 01:09:42.432795 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 01:09:42.484002 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 01:09:42.517251 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 01:09:42.543855 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 01:09:43.104617 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 01:09:43.158203 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:43.169904 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:09:43.244066 tst mo_mt_call.py: using LAC 37497 01:09:43.371627 tst mo_mt_call.py: using RAC 12 01:09:43.498492 tst mo_mt_call.py: using CellId 37497 01:09:43.625382 tst mo_mt_call.py: using BVCI 37498 01:09:43.744782 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:43.756524 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:43.768816 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:43.780394 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:43.792348 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:43.804179 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:09:43.921489 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:09:44.042452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:09:44.547801 run create_hlr_db(pid=22480): Launched 01:09:44.672867 bus /sierra_2: Setting Powered False 01:09:45.737117 run create_hlr_db(pid=22480): Terminated: ok {rc=0} 01:09:46.197763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22482): Launched 01:09:46.555582 run osmo-hlr_10.42.42.2(pid=22483): Launched 01:09:46.795322 run osmo-stp_10.42.42.5: Starting osmo-stp 01:09:47.505792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22485): Launched 01:09:47.812499 run osmo-stp_10.42.42.5(pid=22486): Launched 01:09:47.930997 run osmo-msc_10.42.42.6: Starting osmo-msc 01:09:48.483999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22488): Launched 01:09:48.791886 run osmo-msc_10.42.42.6(pid=22489): Launched 01:09:48.963328 run osmo-stp_10.42.42.5(pid=22486): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22486)] 01:09:49.091939 run osmo-stp_10.42.42.5(pid=22486): stdout: | (launched: 2022-12-14_01:09:47.755960) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:49.220263 run osmo-stp_10.42.42.5(pid=22486): stderr: | [0;m[38;5;43m20221214010947925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010947926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010947926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010947926 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010947927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010947927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010947927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:49.347415 run osmo-stp_10.42.42.5(pid=22486): stdout: | (launched: 2022-12-14_01:09:47.755960) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:49.468364 run osmo-stp_10.42.42.5(pid=22486): stderr: | [0;m[38;5;43m20221214010947925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010947926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010947926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010947926 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010947927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010947927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010947927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:49.613232 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22486): Process ended prematurely: osmo-stp_10.42.42.5(pid=22486) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22486)] [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 01:09:49.622158 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 01:09:49.648301 run osmo-hlr_10.42.42.2(pid=22483): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22483)] 01:09:49.695547 run osmo-hlr_10.42.42.2(pid=22483): stdout: | (launched: 2022-12-14_01:09:46.497743) 01:09:49.744683 run osmo-hlr_10.42.42.2(pid=22483): stderr: | [0;m[1;31m20221214010946837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010946837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010946837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010946837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010946837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010946837 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010946861 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010946869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010946869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010946869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:09:49.813520 run osmo-msc_10.42.42.6(pid=22489): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22489)] 01:09:49.860813 run osmo-msc_10.42.42.6(pid=22489): stdout: | (launched: 2022-12-14_01:09:48.735313) 01:09:49.909784 run osmo-msc_10.42.42.6(pid=22489): stderr: | [0;m[38;5;43m20221214010949007 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010949007 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f473881ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010949007 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010949007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010949007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010949008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010949009 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010949010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010949010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010949010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:09:49.959173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22482): Terminating (SIGTERM) 01:09:49.998574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22485): Terminating (SIGTERM) 01:09:50.038299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22488): Terminating (SIGTERM) 01:09:50.078096 --- ParallelTerminationStrategy: PID 22482 died... 01:09:50.097227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22482): Terminated: ok {rc=0} 01:09:50.140740 --- ParallelTerminationStrategy: PID 22485 died... 01:09:50.159267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22485): Terminated: ok {rc=0} 01:09:50.202649 --- ParallelTerminationStrategy: PID 22488 died... 01:09:50.221146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22488): Terminated: ok {rc=0} 01:09:50.307135 bus /sierra_3: Setting Powered False 01:09:51.406045 bus /sierra_3: Setting Powered False 01:09:52.522795 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 01:09:53.666012 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:53.678024 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:09:53.748515 tst mo_mt_call_osmux.py: using LAC 37498 01:09:53.866393 tst mo_mt_call_osmux.py: using RAC 13 01:09:53.997632 tst mo_mt_call_osmux.py: using CellId 37498 01:09:54.118361 tst mo_mt_call_osmux.py: using BVCI 37499 01:09:54.229899 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:54.241187 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:54.252251 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:54.263367 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:54.274452 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:09:54.285494 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:09:54.405147 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:09:54.522968 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:09:54.997408 run create_hlr_db(pid=22491): Launched 01:09:55.123002 bus /sierra_2: Setting Powered False 01:09:56.183597 run create_hlr_db(pid=22491): Terminated: ok {rc=0} 01:09:56.632499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22493): Launched 01:09:56.963656 run osmo-hlr_10.42.42.2(pid=22494): Launched 01:09:57.091489 run osmo-stp_10.42.42.5: Starting osmo-stp 01:09:57.659892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22496): Launched 01:09:57.991204 run osmo-stp_10.42.42.5(pid=22497): Launched 01:09:58.117521 run osmo-msc_10.42.42.6: Starting osmo-msc 01:09:58.710021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22499): Launched 01:09:59.040300 run osmo-msc_10.42.42.6(pid=22500): Launched 01:09:59.223861 run osmo-stp_10.42.42.5(pid=22497): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22497)] 01:09:59.362043 run osmo-stp_10.42.42.5(pid=22497): stdout: | (launched: 2022-12-14_01:09:57.930961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:59.500720 run osmo-stp_10.42.42.5(pid=22497): stderr: | [0;m[38;5;43m20221214010958122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010958122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010958122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010958122 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010958123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010958123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010958123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:59.637603 run osmo-stp_10.42.42.5(pid=22497): stdout: | (launched: 2022-12-14_01:09:57.930961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:09:59.768186 run osmo-stp_10.42.42.5(pid=22497): stderr: | [0;m[38;5;43m20221214010958122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214010958122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214010958122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214010958122 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214010958123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214010958123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214010958123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:09:59.925008 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22497): Process ended prematurely: osmo-stp_10.42.42.5(pid=22497) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22497)] [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 01:09:59.934823 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:09:59.962578 run osmo-hlr_10.42.42.2(pid=22494): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22494)] 01:10:00.013446 run osmo-hlr_10.42.42.2(pid=22494): stdout: | (launched: 2022-12-14_01:09:56.902784) 01:10:00.065315 run osmo-hlr_10.42.42.2(pid=22494): stderr: | [0;m[1;31m20221214010957099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214010957099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214010957099 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214010957100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214010957100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214010957100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214010957111 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214010957120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214010957120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214010957120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:10:00.137787 run osmo-msc_10.42.42.6(pid=22500): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22500)] 01:10:00.187583 run osmo-msc_10.42.42.6(pid=22500): stdout: | (launched: 2022-12-14_01:09:58.979605) 01:10:00.239830 run osmo-msc_10.42.42.6(pid=22500): stderr: | [0;m[38;5;43m20221214010959301 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214010959301 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f85b1d3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214010959301 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214010959301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214010959302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214010959302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214010959303 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214010959304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214010959304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214010959304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:10:00.292154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22493): Terminating (SIGTERM) 01:10:00.333808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22496): Terminating (SIGTERM) 01:10:00.375924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22499): Terminating (SIGTERM) 01:10:00.418289 --- ParallelTerminationStrategy: PID 22493 died... 01:10:00.438694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22493): Terminated: ok {rc=0} 01:10:00.485206 --- ParallelTerminationStrategy: PID 22496 died... 01:10:00.505081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22496): Terminated: ok {rc=0} 01:10:00.551225 --- ParallelTerminationStrategy: PID 22499 died... 01:10:00.571070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22499): Terminated: ok {rc=0} 01:10:00.659597 bus /sierra_3: Setting Powered False 01:10:01.765571 bus /sierra_3: Setting Powered False 01:10:02.884391 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:10:04.141236 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:10:04.148152 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:10:04.183089 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:10:04.211121 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:10:04.266443 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:10:04.301202 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:10:04.327395 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:10:04.876317 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:10:04.925410 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:04.936649 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:10:05.006012 tst mo_mt_call.py: using LAC 37499 01:10:05.125292 tst mo_mt_call.py: using RAC 14 01:10:05.245042 tst mo_mt_call.py: using CellId 37499 01:10:05.365908 tst mo_mt_call.py: using BVCI 37500 01:10:05.477623 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:05.488840 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:05.500046 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:05.511089 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:05.522358 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:05.533524 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:10:05.653924 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:10:05.771799 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:10:06.247230 run create_hlr_db(pid=22509): Launched 01:10:06.371688 bus /sierra_2: Setting Powered False 01:10:07.432187 run create_hlr_db(pid=22509): Terminated: ok {rc=0} 01:10:07.880432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22511): Launched 01:10:08.210584 run osmo-hlr_10.42.42.2(pid=22512): Launched 01:10:08.337120 run osmo-stp_10.42.42.5: Starting osmo-stp 01:10:08.903857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22514): Launched 01:10:09.234796 run osmo-stp_10.42.42.5(pid=22515): Launched 01:10:09.359865 run osmo-msc_10.42.42.6: Starting osmo-msc 01:10:09.953726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22517): Launched 01:10:10.282673 run osmo-msc_10.42.42.6(pid=22518): Launched 01:10:10.467255 run osmo-stp_10.42.42.5(pid=22515): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22515)] 01:10:10.605782 run osmo-stp_10.42.42.5(pid=22515): stdout: | (launched: 2022-12-14_01:10:09.174204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:10.744502 run osmo-stp_10.42.42.5(pid=22515): stderr: | [0;m[38;5;43m20221214011009366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011009366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011009366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011009366 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011009367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011009367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011009367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:10.881642 run osmo-stp_10.42.42.5(pid=22515): stdout: | (launched: 2022-12-14_01:10:09.174204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:11.011770 run osmo-stp_10.42.42.5(pid=22515): stderr: | [0;m[38;5;43m20221214011009366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011009366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011009366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011009366 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011009367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011009367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011009367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:11.168440 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22515): Process ended prematurely: osmo-stp_10.42.42.5(pid=22515) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22515)] [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:10:11.178164 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:10:11.205804 run osmo-hlr_10.42.42.2(pid=22512): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22512)] 01:10:11.256206 run osmo-hlr_10.42.42.2(pid=22512): stdout: | (launched: 2022-12-14_01:10:08.150226) 01:10:11.308468 run osmo-hlr_10.42.42.2(pid=22512): stderr: | [0;m[1;31m20221214011008346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011008346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011008346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011008346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011008346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011008346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011008359 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011008368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011008368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011008368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:10:11.380734 run osmo-msc_10.42.42.6(pid=22518): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22518)] 01:10:11.430441 run osmo-msc_10.42.42.6(pid=22518): stdout: | (launched: 2022-12-14_01:10:10.222355) 01:10:11.482017 run osmo-msc_10.42.42.6(pid=22518): stderr: | [0;m[38;5;43m20221214011010542 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011010542 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f971a793c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011010542 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011010542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011010542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011010542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011010544 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011010544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011010544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011010544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:10:11.534408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22511): Terminating (SIGTERM) 01:10:11.576290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22514): Terminating (SIGTERM) 01:10:11.618344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22517): Terminating (SIGTERM) 01:10:11.660631 --- ParallelTerminationStrategy: PID 22511 died... 01:10:11.681034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22511): Terminated: ok {rc=0} 01:10:11.727110 --- ParallelTerminationStrategy: PID 22514 died... 01:10:11.746898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22514): Terminated: ok {rc=0} 01:10:11.793300 --- ParallelTerminationStrategy: PID 22517 died... 01:10:11.813144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22517): Terminated: ok {rc=0} 01:10:11.902425 bus /sierra_3: Setting Powered False 01:10:13.003377 bus /sierra_3: Setting Powered False 01:10:14.119602 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:10:15.265038 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:15.277233 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:10:15.347796 tst mo_mt_call_osmux.py: using LAC 37500 01:10:15.478273 tst mo_mt_call_osmux.py: using RAC 15 01:10:15.607792 tst mo_mt_call_osmux.py: using CellId 37500 01:10:15.736608 tst mo_mt_call_osmux.py: using BVCI 37501 01:10:15.864007 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:15.878511 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:15.897463 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:15.909516 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:15.921305 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:10:15.932781 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:10:16.059330 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:10:16.199153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:10:16.746671 run create_hlr_db(pid=22520): Launched 01:10:16.907799 bus /sierra_2: Setting Powered False 01:10:17.974462 run create_hlr_db(pid=22520): Terminated: ok {rc=0} 01:10:18.432145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22522): Launched 01:10:18.763514 run osmo-hlr_10.42.42.2(pid=22523): Launched 01:10:18.890475 run osmo-stp_10.42.42.5: Starting osmo-stp 01:10:19.457624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22525): Launched 01:10:19.789410 run osmo-stp_10.42.42.5(pid=22526): Launched 01:10:19.914100 run osmo-msc_10.42.42.6: Starting osmo-msc 01:10:20.507711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22528): Launched 01:10:20.838645 run osmo-msc_10.42.42.6(pid=22529): Launched 01:10:21.022867 run osmo-stp_10.42.42.5(pid=22526): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22526)] 01:10:21.161965 run osmo-stp_10.42.42.5(pid=22526): stdout: | (launched: 2022-12-14_01:10:19.728770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:21.301896 run osmo-stp_10.42.42.5(pid=22526): stderr: | [0;m[38;5;43m20221214011019920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011019920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011019920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011019920 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011019921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011019921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011019921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:21.439260 run osmo-stp_10.42.42.5(pid=22526): stdout: | (launched: 2022-12-14_01:10:19.728770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:21.569688 run osmo-stp_10.42.42.5(pid=22526): stderr: | [0;m[38;5;43m20221214011019920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011019920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011019920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011019920 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011019921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011019921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011019921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:21.726429 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22526): Process ended prematurely: osmo-stp_10.42.42.5(pid=22526) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22526)] [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:10:21.736283 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 01:10:21.764166 run osmo-hlr_10.42.42.2(pid=22523): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22523)] 01:10:21.815414 run osmo-hlr_10.42.42.2(pid=22523): stdout: | (launched: 2022-12-14_01:10:18.702206) 01:10:21.867556 run osmo-hlr_10.42.42.2(pid=22523): stderr: | [0;m[1;31m20221214011018899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011018899 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011018900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011018900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011018900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011018900 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011018911 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011018920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011018920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011018920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:10:21.939976 run osmo-msc_10.42.42.6(pid=22529): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22529)] 01:10:21.989753 run osmo-msc_10.42.42.6(pid=22529): stdout: | (launched: 2022-12-14_01:10:20.777759) 01:10:22.041725 run osmo-msc_10.42.42.6(pid=22529): stderr: | [0;m[38;5;43m20221214011021097 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011021097 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd183303c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011021098 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011021098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011021098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011021098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011021100 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011021100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011021100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011021100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:10:22.093942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22522): Terminating (SIGTERM) 01:10:22.135306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22525): Terminating (SIGTERM) 01:10:22.177126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22528): Terminating (SIGTERM) 01:10:22.219187 --- ParallelTerminationStrategy: PID 22522 died... 01:10:22.239467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22522): Terminated: ok {rc=0} 01:10:22.285714 --- ParallelTerminationStrategy: PID 22525 died... 01:10:22.305432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22525): Terminated: ok {rc=0} 01:10:22.351430 --- ParallelTerminationStrategy: PID 22528 died... 01:10:22.371182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22528): Terminated: ok {rc=0} 01:10:22.459373 bus /sierra_3: Setting Powered False 01:10:23.558357 bus /sierra_3: Setting Powered False 01:10:24.673803 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:10:25.934559 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:10:25.941792 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:10:25.976917 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:10:26.004804 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:10:26.059385 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:10:26.095454 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:10:26.123520 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:10:26.670818 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:10:26.725537 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:26.737581 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:10:26.814255 tst mo_mt_call.py: using LAC 37501 01:10:26.946847 tst mo_mt_call.py: using RAC 16 01:10:27.073800 tst mo_mt_call.py: using CellId 37501 01:10:27.199269 tst mo_mt_call.py: using BVCI 37502 01:10:27.319430 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:27.331239 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:27.342812 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:27.354388 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:27.366391 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:27.378437 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:10:27.496619 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:10:27.617769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:10:28.124572 run create_hlr_db(pid=22534): Launched 01:10:28.249874 bus /sierra_2: Setting Powered False 01:10:29.314118 run create_hlr_db(pid=22534): Terminated: ok {rc=0} 01:10:29.767990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22536): Launched 01:10:30.097509 run osmo-hlr_10.42.42.2(pid=22537): Launched 01:10:30.224594 run osmo-stp_10.42.42.5: Starting osmo-stp 01:10:30.790961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22539): Launched 01:10:31.144784 run osmo-stp_10.42.42.5(pid=22540): Launched 01:10:31.300360 run osmo-msc_10.42.42.6: Starting osmo-msc 01:10:31.957683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22542): Launched 01:10:32.305708 run osmo-msc_10.42.42.6(pid=22543): Launched 01:10:32.511169 run osmo-stp_10.42.42.5(pid=22540): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22540)] 01:10:32.643719 run osmo-stp_10.42.42.5(pid=22540): stdout: | (launched: 2022-12-14_01:10:31.083680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:32.774983 run osmo-stp_10.42.42.5(pid=22540): stderr: | [0;m[38;5;43m20221214011031459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011031459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011031459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011031460 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011031460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011031461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011031461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:32.904646 run osmo-stp_10.42.42.5(pid=22540): stdout: | (launched: 2022-12-14_01:10:31.083680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:33.026874 run osmo-stp_10.42.42.5(pid=22540): stderr: | [0;m[38;5;43m20221214011031459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011031459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011031459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011031460 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011031460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011031461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011031461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:33.172297 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22540): Process ended prematurely: osmo-stp_10.42.42.5(pid=22540) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22540)] [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:10:33.181785 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 01:10:33.208039 run osmo-hlr_10.42.42.2(pid=22537): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22537)] 01:10:33.255653 run osmo-hlr_10.42.42.2(pid=22537): stdout: | (launched: 2022-12-14_01:10:30.037703) 01:10:33.305884 run osmo-hlr_10.42.42.2(pid=22537): stderr: | [0;m[1;31m20221214011030234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011030234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011030235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011030235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011030235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011030235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011030246 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011030255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011030255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011030255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:10:33.375134 run osmo-msc_10.42.42.6(pid=22543): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22543)] 01:10:33.422904 run osmo-msc_10.42.42.6(pid=22543): stdout: | (launched: 2022-12-14_01:10:32.243132) 01:10:33.472466 run osmo-msc_10.42.42.6(pid=22543): stderr: | [0;m[38;5;43m20221214011032586 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011032586 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6733773c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011032586 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011032586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011032586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011032587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011032588 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011032589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011032589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011032589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:10:33.522208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22536): Terminating (SIGTERM) 01:10:33.562159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22539): Terminating (SIGTERM) 01:10:33.602179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22542): Terminating (SIGTERM) 01:10:33.642539 --- ParallelTerminationStrategy: PID 22536 died... 01:10:33.661824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22536): Terminated: ok {rc=0} 01:10:33.705892 --- ParallelTerminationStrategy: PID 22539 died... 01:10:33.724497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22539): Terminated: ok {rc=0} 01:10:33.768243 --- ParallelTerminationStrategy: PID 22542 died... 01:10:33.786938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22542): Terminated: ok {rc=0} 01:10:33.872609 bus /sierra_3: Setting Powered False 01:10:34.972208 bus /sierra_3: Setting Powered False 01:10:36.085459 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:10:37.234557 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:37.247152 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:10:37.323497 tst mo_mt_call_osmux.py: using LAC 37502 01:10:37.465440 tst mo_mt_call_osmux.py: using RAC 17 01:10:37.594969 tst mo_mt_call_osmux.py: using CellId 37502 01:10:37.725924 tst mo_mt_call_osmux.py: using BVCI 37503 01:10:37.846800 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:37.858662 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:37.870312 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:37.881991 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:37.894069 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:10:37.906009 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:10:38.027867 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:10:38.147830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:10:38.657357 run create_hlr_db(pid=22545): Launched 01:10:38.782953 bus /sierra_2: Setting Powered False 01:10:39.847878 run create_hlr_db(pid=22545): Terminated: ok {rc=0} 01:10:40.286089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22547): Launched 01:10:40.593025 run osmo-hlr_10.42.42.2(pid=22548): Launched 01:10:40.710201 run osmo-stp_10.42.42.5: Starting osmo-stp 01:10:41.249074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22550): Launched 01:10:41.554889 run osmo-stp_10.42.42.5(pid=22551): Launched 01:10:41.671313 run osmo-msc_10.42.42.6: Starting osmo-msc 01:10:42.224921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22553): Launched 01:10:42.531249 run osmo-msc_10.42.42.6(pid=22554): Launched 01:10:42.701459 run osmo-stp_10.42.42.5(pid=22551): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22551)] 01:10:42.829863 run osmo-stp_10.42.42.5(pid=22551): stdout: | (launched: 2022-12-14_01:10:41.498526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:42.958219 run osmo-stp_10.42.42.5(pid=22551): stderr: | [0;m[38;5;43m20221214011041670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011041670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011041671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011041671 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011041671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011041672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011041672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:43.084863 run osmo-stp_10.42.42.5(pid=22551): stdout: | (launched: 2022-12-14_01:10:41.498526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:43.205714 run osmo-stp_10.42.42.5(pid=22551): stderr: | [0;m[38;5;43m20221214011041670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011041670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011041671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011041671 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011041671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011041672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011041672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:43.350967 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22551): Process ended prematurely: osmo-stp_10.42.42.5(pid=22551) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22551)] [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:10:43.360293 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:10:43.386975 run osmo-hlr_10.42.42.2(pid=22548): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22548)] 01:10:43.434042 run osmo-hlr_10.42.42.2(pid=22548): stdout: | (launched: 2022-12-14_01:10:40.536213) 01:10:43.482650 run osmo-hlr_10.42.42.2(pid=22548): stderr: | [0;m[1;31m20221214011040711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011040711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011040712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011040712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011040712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011040712 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011040724 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011040732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011040732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011040732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:10:43.550517 run osmo-msc_10.42.42.6(pid=22554): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22554)] 01:10:43.597474 run osmo-msc_10.42.42.6(pid=22554): stdout: | (launched: 2022-12-14_01:10:42.474702) 01:10:43.646073 run osmo-msc_10.42.42.6(pid=22554): stderr: | [0;m[38;5;43m20221214011042746 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011042746 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc1b8663c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011042746 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011042746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011042746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011042747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011042748 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011042749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011042749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011042749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:10:43.695296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22547): Terminating (SIGTERM) 01:10:43.734386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22550): Terminating (SIGTERM) 01:10:43.773520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22553): Terminating (SIGTERM) 01:10:43.813158 --- ParallelTerminationStrategy: PID 22547 died... 01:10:43.832122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22547): Terminated: ok {rc=0} 01:10:43.875612 --- ParallelTerminationStrategy: PID 22550 died... 01:10:43.894226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22550): Terminated: ok {rc=0} 01:10:43.937423 --- ParallelTerminationStrategy: PID 22553 died... 01:10:43.955884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22553): Terminated: ok {rc=0} 01:10:44.038322 bus /sierra_3: Setting Powered False 01:10:45.135717 bus /sierra_3: Setting Powered False 01:10:46.252261 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:10:47.503532 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:10:47.509645 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:10:47.543644 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 01:10:47.570969 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 01:10:47.623045 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:10:47.656579 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 01:10:47.683235 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 01:10:48.232789 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 01:10:48.282193 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:48.293245 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:10:48.368451 tst mo_mt_call.py: using LAC 37503 01:10:48.488461 tst mo_mt_call.py: using RAC 18 01:10:48.609606 tst mo_mt_call.py: using CellId 37503 01:10:48.737868 tst mo_mt_call.py: using BVCI 37504 01:10:48.857921 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:48.869763 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:48.881334 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:48.892819 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:48.904913 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:48.917293 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:10:49.034692 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:10:49.155738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:10:49.663583 run create_hlr_db(pid=22559): Launched 01:10:49.790006 bus /sierra_2: Setting Powered False 01:10:50.855096 run create_hlr_db(pid=22559): Terminated: ok {rc=0} 01:10:51.294962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22561): Launched 01:10:51.603243 run osmo-hlr_10.42.42.2(pid=22562): Launched 01:10:51.722510 run osmo-stp_10.42.42.5: Starting osmo-stp 01:10:52.294406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22567): Launched 01:10:52.623422 run osmo-stp_10.42.42.5(pid=22568): Launched 01:10:52.750640 run osmo-msc_10.42.42.6: Starting osmo-msc 01:10:53.344683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22570): Launched 01:10:53.675047 run osmo-msc_10.42.42.6(pid=22571): Launched 01:10:53.857852 run osmo-stp_10.42.42.5(pid=22568): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22568)] 01:10:53.995879 run osmo-stp_10.42.42.5(pid=22568): stdout: | (launched: 2022-12-14_01:10:52.563389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:54.135003 run osmo-stp_10.42.42.5(pid=22568): stderr: | [0;m[38;5;43m20221214011052754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011052754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011052754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011052754 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011052755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011052755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011052755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:54.271795 run osmo-stp_10.42.42.5(pid=22568): stdout: | (launched: 2022-12-14_01:10:52.563389) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:10:54.402096 run osmo-stp_10.42.42.5(pid=22568): stderr: | [0;m[38;5;43m20221214011052754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011052754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011052754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011052754 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011052755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011052755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011052755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:10:54.557982 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22568): Process ended prematurely: osmo-stp_10.42.42.5(pid=22568) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22568)] [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 01:10:54.567677 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:10:54.595420 run osmo-hlr_10.42.42.2(pid=22562): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22562)] 01:10:54.645891 run osmo-hlr_10.42.42.2(pid=22562): stdout: | (launched: 2022-12-14_01:10:51.546632) 01:10:54.698181 run osmo-hlr_10.42.42.2(pid=22562): stderr: | [0;m[1;31m20221214011051722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011051722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011051722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011051722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011051722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011051722 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011051771 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011051781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011051781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011051782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:10:54.770544 run osmo-msc_10.42.42.6(pid=22571): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22571)] 01:10:54.820670 run osmo-msc_10.42.42.6(pid=22571): stdout: | (launched: 2022-12-14_01:10:53.614233) 01:10:54.872525 run osmo-msc_10.42.42.6(pid=22571): stderr: | [0;m[38;5;43m20221214011053934 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011053934 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feed9f76c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011053934 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011053934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011053934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011053935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011053936 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011053937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011053937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011053937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:10:54.924569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22561): Terminating (SIGTERM) 01:10:54.966352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22567): Terminating (SIGTERM) 01:10:55.008166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22570): Terminating (SIGTERM) 01:10:55.050104 --- ParallelTerminationStrategy: PID 22561 died... 01:10:55.070311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22561): Terminated: ok {rc=0} 01:10:55.116853 --- ParallelTerminationStrategy: PID 22567 died... 01:10:55.137217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22567): Terminated: ok {rc=0} 01:10:55.183469 --- ParallelTerminationStrategy: PID 22570 died... 01:10:55.203391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22570): Terminated: ok {rc=0} 01:10:55.294116 bus /sierra_3: Setting Powered False 01:10:56.393949 bus /sierra_3: Setting Powered False 01:10:57.511929 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 01:10:58.656428 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:58.668411 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:10:58.740363 tst mo_mt_call_osmux.py: using LAC 37504 01:10:58.862158 tst mo_mt_call_osmux.py: using RAC 19 01:10:58.982199 tst mo_mt_call_osmux.py: using CellId 37504 01:10:59.103628 tst mo_mt_call_osmux.py: using BVCI 37505 01:10:59.215485 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:59.226633 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:59.237637 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:59.248464 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:59.259459 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:10:59.270437 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:10:59.386374 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:10:59.511893 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:10:59.985341 run create_hlr_db(pid=22573): Launched 01:11:00.110381 bus /sierra_2: Setting Powered False 01:11:01.171107 run create_hlr_db(pid=22573): Terminated: ok {rc=0} 01:11:01.629711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22575): Launched 01:11:01.955377 run osmo-hlr_10.42.42.2(pid=22576): Launched 01:11:02.176808 run osmo-stp_10.42.42.5: Starting osmo-stp 01:11:02.719200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22578): Launched 01:11:03.025100 run osmo-stp_10.42.42.5(pid=22579): Launched 01:11:03.140734 run osmo-msc_10.42.42.6: Starting osmo-msc 01:11:03.692889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22581): Launched 01:11:03.999980 run osmo-msc_10.42.42.6(pid=22582): Launched 01:11:04.171720 run osmo-stp_10.42.42.5(pid=22579): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22579)] 01:11:04.299936 run osmo-stp_10.42.42.5(pid=22579): stdout: | (launched: 2022-12-14_01:11:02.968567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:04.428339 run osmo-stp_10.42.42.5(pid=22579): stderr: | [0;m[38;5;43m20221214011103138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011103138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011103139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011103139 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011103139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011103140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011103140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:04.555091 run osmo-stp_10.42.42.5(pid=22579): stdout: | (launched: 2022-12-14_01:11:02.968567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:04.675831 run osmo-stp_10.42.42.5(pid=22579): stderr: | [0;m[38;5;43m20221214011103138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011103138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011103139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011103139 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011103139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011103140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011103140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:04.820373 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22579): Process ended prematurely: osmo-stp_10.42.42.5(pid=22579) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22579)] [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 01:11:04.829732 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:11:04.856234 run osmo-hlr_10.42.42.2(pid=22576): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22576)] 01:11:04.903931 run osmo-hlr_10.42.42.2(pid=22576): stdout: | (launched: 2022-12-14_01:11:01.897445) 01:11:04.952916 run osmo-hlr_10.42.42.2(pid=22576): stderr: | [0;m[1;31m20221214011102190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011102190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011102190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011102190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011102190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011102190 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011102205 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011102212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011102213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011102213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:11:05.021450 run osmo-msc_10.42.42.6(pid=22582): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22582)] 01:11:05.068435 run osmo-msc_10.42.42.6(pid=22582): stdout: | (launched: 2022-12-14_01:11:03.942522) 01:11:05.117457 run osmo-msc_10.42.42.6(pid=22582): stderr: | [0;m[38;5;43m20221214011104212 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011104212 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8621f2dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011104212 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011104212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011104212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011104212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011104214 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011104214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011104215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011104215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:11:05.166689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22575): Terminating (SIGTERM) 01:11:05.206076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22578): Terminating (SIGTERM) 01:11:05.245453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22581): Terminating (SIGTERM) 01:11:05.285646 --- ParallelTerminationStrategy: PID 22575 died... 01:11:05.304726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22575): Terminated: ok {rc=0} 01:11:05.348819 --- ParallelTerminationStrategy: PID 22578 died... 01:11:05.367600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22578): Terminated: ok {rc=0} 01:11:05.411152 --- ParallelTerminationStrategy: PID 22581 died... 01:11:05.429782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22581): Terminated: ok {rc=0} 01:11:05.514425 bus /sierra_3: Setting Powered False 01:11:06.612549 bus /sierra_3: Setting Powered False 01:11:07.727220 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 01:11:08.977301 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:11:08.981537 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 01:11:09.014684 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 01:11:09.041121 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 01:11:09.125628 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 01:11:09.159062 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 01:11:09.185440 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 01:11:09.769917 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2397 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 01:11:09.774880 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:09.785718 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:11:09.834558 tst emergency_mo_mt_call.py: using LAC 37505 01:11:09.951303 tst emergency_mo_mt_call.py: using RAC 20 01:11:10.073072 tst emergency_mo_mt_call.py: using CellId 37505 01:11:10.189178 tst emergency_mo_mt_call.py: using BVCI 37506 01:11:10.297298 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:10.308138 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:10.318814 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:10.329374 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:10.339936 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:10.350615 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:10.470718 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:10.587689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:11:11.051544 run create_hlr_db(pid=22587): Launched 01:11:11.173933 bus /sierra_2: Setting Powered False 01:11:12.234872 run create_hlr_db(pid=22587): Terminated: ok {rc=0} 01:11:12.676829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22589): Launched 01:11:13.001252 run osmo-hlr_10.42.42.2(pid=22590): Launched 01:11:13.125082 run osmo-stp_10.42.42.5: Starting osmo-stp 01:11:13.683021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22592): Launched 01:11:14.006286 run osmo-stp_10.42.42.5(pid=22593): Launched 01:11:14.144805 tst emergency_mo_mt_call.py: using MSISDN 8426 01:11:14.310191 run osmo-msc_10.42.42.6: Starting osmo-msc 01:11:14.890328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22595): Launched 01:11:15.215003 run osmo-msc_10.42.42.6(pid=22596): Launched 01:11:15.395218 run osmo-stp_10.42.42.5(pid=22593): ERR: Terminated: ERROR {rc=1} [trial-2397↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22593)] 01:11:15.531049 run osmo-stp_10.42.42.5(pid=22593): stdout: | (launched: 2022-12-14_01:11:13.947153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:15.667339 run osmo-stp_10.42.42.5(pid=22593): stderr: | [0;m[38;5;43m20221214011114139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011114139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011114139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011114140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011114140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011114140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011114140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:15.801916 run osmo-stp_10.42.42.5(pid=22593): stdout: | (launched: 2022-12-14_01:11:13.947153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:15.959772 run osmo-stp_10.42.42.5(pid=22593): stderr: | [0;m[38;5;43m20221214011114139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011114139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011114139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011114140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011114140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011114140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011114140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:16.148747 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=22593): Process ended prematurely: osmo-stp_10.42.42.5(pid=22593) [trial-2397↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22593)] [trial-2397↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 01:11:16.162745 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 01:11:16.201668 run osmo-hlr_10.42.42.2(pid=22590): ERR: Terminated: ERROR {rc=237} [trial-2397↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22590)] 01:11:16.269999 run osmo-hlr_10.42.42.2(pid=22590): stdout: | (launched: 2022-12-14_01:11:12.942245) 01:11:16.339414 run osmo-hlr_10.42.42.2(pid=22590): stderr: | [0;m[1;31m20221214011113138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011113138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011113138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011113138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011113138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011113138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011113150 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011113158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011113158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011113158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:11:16.430171 run osmo-msc_10.42.42.6(pid=22596): ERR: Terminated: ERROR {rc=2} [trial-2397↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22596)] 01:11:16.496618 run osmo-msc_10.42.42.6(pid=22596): stdout: | (launched: 2022-12-14_01:11:15.154990) 01:11:16.560710 run osmo-msc_10.42.42.6(pid=22596): stderr: | [0;m[38;5;43m20221214011115473 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011115473 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7455ff0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011115473 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011115473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011115473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011115474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011115475 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011115476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011115476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011115476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:11:16.628534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22589): Terminating (SIGTERM) 01:11:16.672076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22592): Terminating (SIGTERM) 01:11:16.717565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22595): Terminating (SIGTERM) 01:11:16.762687 --- ParallelTerminationStrategy: PID 22589 died... 01:11:16.785316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22589): Terminated: ok {rc=0} 01:11:16.833920 --- ParallelTerminationStrategy: PID 22592 died... 01:11:16.854554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22592): Terminated: ok {rc=0} 01:11:16.901458 --- ParallelTerminationStrategy: PID 22595 died... 01:11:16.922333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22595): Terminated: ok {rc=0} 01:11:17.013701 bus /sierra_3: Setting Powered False 01:11:18.113812 bus /sierra_3: Setting Powered False 01:11:19.230027 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 01:11:20.316038 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:20.328126 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:11:20.383392 tst emergency_preemptive_call.py: using LAC 37506 01:11:20.511637 tst emergency_preemptive_call.py: using RAC 21 01:11:20.631292 tst emergency_preemptive_call.py: using CellId 37506 01:11:20.748806 tst emergency_preemptive_call.py: using BVCI 37507 01:11:20.867946 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:20.879372 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:20.890892 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:20.902231 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:20.914255 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:11:20.926242 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:21.044422 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:21.166212 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:21.282549 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:21.401651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:11:21.902873 run create_hlr_db(pid=22598): Launched 01:11:22.027422 bus /sierra_2: Setting Powered False 01:11:23.091306 run create_hlr_db(pid=22598): Terminated: ok {rc=0} 01:11:23.523273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22600): Launched 01:11:23.827412 run osmo-hlr_10.42.42.2(pid=22601): Launched 01:11:23.942277 run osmo-stp_10.42.42.5: Starting osmo-stp 01:11:24.473958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22603): Launched 01:11:24.775010 run osmo-stp_10.42.42.5(pid=22604): Launched 01:11:24.899201 tst emergency_preemptive_call.py: using MSISDN 8427 01:11:25.051421 run osmo-msc_10.42.42.6: Starting osmo-msc 01:11:25.591350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22606): Launched 01:11:25.892615 run osmo-msc_10.42.42.6(pid=22607): Launched 01:11:26.062106 run osmo-stp_10.42.42.5(pid=22604): ERR: Terminated: ERROR {rc=1} [trial-2397↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22604)] 01:11:26.188457 run osmo-stp_10.42.42.5(pid=22604): stdout: | (launched: 2022-12-14_01:11:24.719247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:26.314929 run osmo-stp_10.42.42.5(pid=22604): stderr: | [0;m[38;5;43m20221214011124886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011124886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011124887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011124887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011124888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011124888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011124888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:26.439561 run osmo-stp_10.42.42.5(pid=22604): stdout: | (launched: 2022-12-14_01:11:24.719247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:26.558697 run osmo-stp_10.42.42.5(pid=22604): stderr: | [0;m[38;5;43m20221214011124886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011124886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011124887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011124887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011124888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011124888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011124888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:26.701395 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=22604): Process ended prematurely: osmo-stp_10.42.42.5(pid=22604) [trial-2397↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22604)] [trial-2397↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 01:11:26.709981 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 01:11:26.736256 run osmo-hlr_10.42.42.2(pid=22601): ERR: Terminated: ERROR {rc=237} [trial-2397↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22601)] 01:11:26.784244 run osmo-hlr_10.42.42.2(pid=22601): stdout: | (launched: 2022-12-14_01:11:23.771814) 01:11:26.833773 run osmo-hlr_10.42.42.2(pid=22601): stderr: | [0;m[1;31m20221214011123944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011123944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011123945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011123945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011123945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011123945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011123957 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011123967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011123967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011123967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:11:26.902847 run osmo-msc_10.42.42.6(pid=22607): ERR: Terminated: ERROR {rc=2} [trial-2397↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22607)] 01:11:26.950289 run osmo-msc_10.42.42.6(pid=22607): stdout: | (launched: 2022-12-14_01:11:25.836882) 01:11:26.999610 run osmo-msc_10.42.42.6(pid=22607): stderr: | [0;m[38;5;43m20221214011126107 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011126108 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4ecb2b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011126108 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011126108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011126108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011126108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011126110 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011126110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011126111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011126111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:11:27.049261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22600): Terminating (SIGTERM) 01:11:27.088865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22603): Terminating (SIGTERM) 01:11:27.128436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22606): Terminating (SIGTERM) 01:11:27.168231 --- ParallelTerminationStrategy: PID 22600 died... 01:11:27.187508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22600): Terminated: ok {rc=0} 01:11:27.231370 --- ParallelTerminationStrategy: PID 22603 died... 01:11:27.250241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22603): Terminated: ok {rc=0} 01:11:27.293927 --- ParallelTerminationStrategy: PID 22606 died... 01:11:27.312570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22606): Terminated: ok {rc=0} 01:11:27.397550 bus /sierra_9: Setting Powered False 01:11:28.495803 bus /sierra_9: Setting Powered False 01:11:29.608415 bus /sierra_8: Setting Powered False 01:11:30.705501 bus /sierra_8: Setting Powered False 01:11:31.822365 bus /sierra_3: Setting Powered False 01:11:32.918706 bus /sierra_3: Setting Powered False 01:11:34.034114 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 01:11:35.320323 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:11:35.324618 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 01:11:35.357807 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 01:11:35.396045 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 01:11:35.482147 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 01:11:35.515397 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 01:11:35.553342 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 01:11:36.144787 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 01:11:36.194312 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:36.205090 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:11:36.254455 tst cs_paging_gprs_active.py: using LAC 37507 01:11:36.375737 tst cs_paging_gprs_active.py: using RAC 22 01:11:36.495675 tst cs_paging_gprs_active.py: using CellId 37507 01:11:36.617299 tst cs_paging_gprs_active.py: using BVCI 37508 01:11:36.727476 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:36.738309 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:36.748827 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:36.759435 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:36.769941 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:36.780445 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:36.791097 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:36.801564 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:36.812784 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:36.933581 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:37.054574 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:11:37.277108 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:11:37.607445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22612): Launched 01:11:37.897490 run iperf3-srv_10.42.42.10(pid=22613): Launched 01:11:38.021971 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:11:38.246127 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:11:38.579656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22614): Launched 01:11:38.866799 run iperf3-srv_10.42.42.10(pid=22615): Launched 01:11:38.992575 tst cs_paging_gprs_active.py:38: start network... 01:11:39.214931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:11:39.724024 run create_hlr_db(pid=22616): Launched 01:11:39.850639 bus /sierra_2: Setting Powered False 01:11:40.914921 run create_hlr_db(pid=22616): Terminated: ok {rc=0} 01:11:41.374716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22618): Launched 01:11:41.706022 run osmo-hlr_10.42.42.2(pid=22619): Launched 01:11:41.834482 run osmo-stp_10.42.42.5: Starting osmo-stp 01:11:42.401717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22621): Launched 01:11:42.731167 run osmo-stp_10.42.42.5(pid=22622): Launched 01:11:42.859831 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:11:43.427978 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22624): Launched 01:11:43.556913 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:11:43.836172 run patchelf(pid=22625): Launched 01:11:44.021439 run osmo-stp_10.42.42.5(pid=22622): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22622)] 01:11:44.160785 run osmo-stp_10.42.42.5(pid=22622): stdout: | (launched: 2022-12-14_01:11:42.670472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:44.301740 run osmo-stp_10.42.42.5(pid=22622): stderr: | [0;m[38;5;43m20221214011142862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011142862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011142862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011142862 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011142863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011142863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011142863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:44.442763 run osmo-stp_10.42.42.5(pid=22622): stdout: | (launched: 2022-12-14_01:11:42.670472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:44.577612 run osmo-stp_10.42.42.5(pid=22622): stderr: | [0;m[38;5;43m20221214011142862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011142862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011142862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011142862 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011142863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011142863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011142863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:44.737181 run patchelf(pid=22625): Terminating (SIGINT) 01:11:44.922230 run patchelf(pid=22625): Terminated: ok {rc=0} 01:11:45.055257 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22622): Process ended prematurely: osmo-stp_10.42.42.5(pid=22622) [trial-2397↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22622)] [trial-2397↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 01:11:45.065675 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 01:11:45.093940 run osmo-hlr_10.42.42.2(pid=22619): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22619)] 01:11:45.144521 run osmo-hlr_10.42.42.2(pid=22619): stdout: | (launched: 2022-12-14_01:11:41.645620) 01:11:45.196565 run osmo-hlr_10.42.42.2(pid=22619): stderr: | [0;m[1;31m20221214011141843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011141843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011141843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011141843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011141843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011141843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011141854 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011141862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011141863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011141863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:11:45.249155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22612): Terminating (SIGTERM) 01:11:45.290685 run iperf3-srv_10.42.42.10(pid=22613): Terminating (SIGTERM) 01:11:45.332884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22614): Terminating (SIGTERM) 01:11:45.374893 run iperf3-srv_10.42.42.10(pid=22615): Terminating (SIGTERM) 01:11:45.416541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22618): Terminating (SIGTERM) 01:11:45.458314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22621): Terminating (SIGTERM) 01:11:45.500000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22624): Terminating (SIGTERM) 01:11:45.542061 --- ParallelTerminationStrategy: PID 22612 died... 01:11:45.562327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22612): Terminated: ok {rc=0} 01:11:45.608353 --- ParallelTerminationStrategy: PID 22613 died... 01:11:45.628023 run iperf3-srv_10.42.42.10(pid=22613): Terminated {rc=256} 01:11:45.673806 --- ParallelTerminationStrategy: PID 22614 died... 01:11:45.693530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22614): Terminated: ok {rc=0} 01:11:45.739190 --- ParallelTerminationStrategy: PID 22615 died... 01:11:45.758948 run iperf3-srv_10.42.42.10(pid=22615): Terminated {rc=256} 01:11:45.804614 --- ParallelTerminationStrategy: PID 22618 died... 01:11:45.824346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22618): Terminated: ok {rc=0} 01:11:45.876190 --- ParallelTerminationStrategy: PID 22621 died... 01:11:45.897418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22621): Terminated: ok {rc=0} 01:11:45.957570 --- ParallelTerminationStrategy: PID 22624 died... 01:11:45.978667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22624): Terminated: ok {rc=0} 01:11:46.070211 bus /gobi_0: Setting Powered False 01:11:47.171346 bus /gobi_0: Setting Powered False 01:11:48.291017 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 01:11:49.443880 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:49.455931 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:11:49.510245 tst iperf3.py: using LAC 37508 01:11:49.640155 tst iperf3.py: using RAC 23 01:11:49.769205 tst iperf3.py: using CellId 37508 01:11:49.896800 tst iperf3.py: using BVCI 37509 01:11:50.016191 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:50.027579 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:50.038704 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:50.049805 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:50.061163 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:50.072415 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:50.083949 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:50.095267 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:50.106925 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:50.224154 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:11:50.430377 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:11:50.737588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22626): Launched 01:11:51.007061 run iperf3-srv_10.42.42.10(pid=22627): Launched 01:11:51.123512 tst iperf3.py:8: start network... 01:11:51.328404 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:11:51.803773 run create_hlr_db(pid=22628): Launched 01:11:51.930794 bus /gobi_6: Setting Powered False 01:11:52.991723 run create_hlr_db(pid=22628): Terminated: ok {rc=0} 01:11:53.440912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22630): Launched 01:11:53.771337 run osmo-hlr_10.42.42.2(pid=22631): Launched 01:11:53.898618 run osmo-stp_10.42.42.5: Starting osmo-stp 01:11:54.469833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22633): Launched 01:11:54.799514 run osmo-stp_10.42.42.5(pid=22634): Launched 01:11:54.927335 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:11:55.496049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22636): Launched 01:11:55.624319 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:11:55.903616 run patchelf(pid=22637): Launched 01:11:56.089320 run osmo-stp_10.42.42.5(pid=22634): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22634)] 01:11:56.229090 run osmo-stp_10.42.42.5(pid=22634): stdout: | (launched: 2022-12-14_01:11:54.739165) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:56.371326 run osmo-stp_10.42.42.5(pid=22634): stderr: | [0;m[38;5;43m20221214011154930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011154930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011154931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011154931 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011154931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011154931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011154932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:56.513747 run osmo-stp_10.42.42.5(pid=22634): stdout: | (launched: 2022-12-14_01:11:54.739165) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:11:56.648771 run osmo-stp_10.42.42.5(pid=22634): stderr: | [0;m[38;5;43m20221214011154930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011154930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011154931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011154931 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011154931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011154931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011154932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:11:56.808815 run patchelf(pid=22637): Terminating (SIGINT) 01:11:56.993991 run patchelf(pid=22637): Terminated: ok {rc=0} 01:11:57.127653 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22634): Process ended prematurely: osmo-stp_10.42.42.5(pid=22634) [trial-2397↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22634)] [trial-2397↪gprs:trx-sysmocell5000↪iperf3.py:8] 01:11:57.138755 tst iperf3.py:8: Test FAILED (7.7 sec) 01:11:57.167516 run osmo-hlr_10.42.42.2(pid=22631): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22631)] 01:11:57.218875 run osmo-hlr_10.42.42.2(pid=22631): stdout: | (launched: 2022-12-14_01:11:53.710480) 01:11:57.271802 run osmo-hlr_10.42.42.2(pid=22631): stderr: | [0;m[1;31m20221214011153906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011153906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011153906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011153907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011153907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011153907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011153919 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011153930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011153930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011153930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:11:57.325286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22626): Terminating (SIGTERM) 01:11:57.368086 run iperf3-srv_10.42.42.10(pid=22627): Terminating (SIGTERM) 01:11:57.410925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22630): Terminating (SIGTERM) 01:11:57.453573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22633): Terminating (SIGTERM) 01:11:57.495773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22636): Terminating (SIGTERM) 01:11:57.538454 --- ParallelTerminationStrategy: PID 22626 died... 01:11:57.559017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22626): Terminated: ok {rc=0} 01:11:57.606112 --- ParallelTerminationStrategy: PID 22627 died... 01:11:57.626278 run iperf3-srv_10.42.42.10(pid=22627): Terminated {rc=256} 01:11:57.673090 --- ParallelTerminationStrategy: PID 22630 died... 01:11:57.693110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22630): Terminated: ok {rc=0} 01:11:57.739493 --- ParallelTerminationStrategy: PID 22633 died... 01:11:57.759538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22633): Terminated: ok {rc=0} 01:11:57.806578 --- ParallelTerminationStrategy: PID 22636 died... 01:11:57.826846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22636): Terminated: ok {rc=0} 01:11:57.915944 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 01:11:59.068172 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:59.080302 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:11:59.132183 tst iperf3m4.py: using LAC 37509 01:11:59.261667 tst iperf3m4.py: using RAC 24 01:11:59.389377 tst iperf3m4.py: using CellId 37509 01:11:59.517149 tst iperf3m4.py: using BVCI 37510 01:11:59.636432 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:59.647858 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:59.658980 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:59.670109 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:59.681563 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:59.692760 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:59.704358 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:59.715741 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:11:59.727392 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:59.848634 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:11:59.966472 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:12:00.084227 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:12:00.200209 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:12:00.405473 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:00.712345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22638): Launched 01:12:01.033546 run iperf3-srv_10.42.42.10(pid=22639): Launched 01:12:01.159184 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:12:01.367260 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:01.681676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22640): Launched 01:12:01.973693 run iperf3-srv_10.42.42.10(pid=22641): Launched 01:12:02.104744 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:12:02.314546 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:02.623167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22642): Launched 01:12:02.892244 run iperf3-srv_10.42.42.10(pid=22643): Launched 01:12:03.006953 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:12:03.211104 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:03.520575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22644): Launched 01:12:03.787585 run iperf3-srv_10.42.42.10(pid=22645): Launched 01:12:03.902889 tst iperf3m4.py:8: start network... 01:12:04.107590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:12:04.582117 run create_hlr_db(pid=22646): Launched 01:12:04.709430 bus /gobi_6: Setting Powered False 01:12:05.769684 run create_hlr_db(pid=22646): Terminated: ok {rc=0} 01:12:06.219773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22648): Launched 01:12:06.550859 run osmo-hlr_10.42.42.2(pid=22649): Launched 01:12:06.678363 run osmo-stp_10.42.42.5: Starting osmo-stp 01:12:07.251695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22651): Launched 01:12:07.585369 run osmo-stp_10.42.42.5(pid=22652): Launched 01:12:07.713012 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:12:08.286608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22654): Launched 01:12:08.414099 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:12:08.693555 run patchelf(pid=22655): Launched 01:12:08.879236 run osmo-stp_10.42.42.5(pid=22652): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22652)] 01:12:09.020329 run osmo-stp_10.42.42.5(pid=22652): stdout: | (launched: 2022-12-14_01:12:07.524236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:09.163230 run osmo-stp_10.42.42.5(pid=22652): stderr: | [0;m[38;5;43m20221214011207716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011207716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011207716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011207716 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011207717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011207717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011207717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:09.306142 run osmo-stp_10.42.42.5(pid=22652): stdout: | (launched: 2022-12-14_01:12:07.524236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:09.442231 run osmo-stp_10.42.42.5(pid=22652): stderr: | [0;m[38;5;43m20221214011207716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011207716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011207716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011207716 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011207717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011207717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011207717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:09.603508 run patchelf(pid=22655): Terminating (SIGINT) 01:12:09.789309 run patchelf(pid=22655): Terminated: ok {rc=0} 01:12:09.924274 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22652): Process ended prematurely: osmo-stp_10.42.42.5(pid=22652) [trial-2397↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22652)] [trial-2397↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 01:12:09.934744 tst iperf3m4.py:8: Test FAILED (10.9 sec) 01:12:09.963794 run osmo-hlr_10.42.42.2(pid=22649): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22649)] 01:12:10.015075 run osmo-hlr_10.42.42.2(pid=22649): stdout: | (launched: 2022-12-14_01:12:06.490326) 01:12:10.068554 run osmo-hlr_10.42.42.2(pid=22649): stderr: | [0;m[1;31m20221214011206687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011206687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011206687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011206687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011206688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011206688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011206700 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011206709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011206709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011206709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:12:10.121954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22638): Terminating (SIGTERM) 01:12:10.164248 run iperf3-srv_10.42.42.10(pid=22639): Terminating (SIGTERM) 01:12:10.207305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22640): Terminating (SIGTERM) 01:12:10.250181 run iperf3-srv_10.42.42.10(pid=22641): Terminating (SIGTERM) 01:12:10.292509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22642): Terminating (SIGTERM) 01:12:10.335577 run iperf3-srv_10.42.42.10(pid=22643): Terminating (SIGTERM) 01:12:10.378103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22644): Terminating (SIGTERM) 01:12:10.420579 run iperf3-srv_10.42.42.10(pid=22645): Terminating (SIGTERM) 01:12:10.463088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22648): Terminating (SIGTERM) 01:12:10.505768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22651): Terminating (SIGTERM) 01:12:10.548443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22654): Terminating (SIGTERM) 01:12:10.591536 --- ParallelTerminationStrategy: PID 22638 died... 01:12:10.612281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22638): Terminated: ok {rc=0} 01:12:10.659045 --- ParallelTerminationStrategy: PID 22639 died... 01:12:10.678983 run iperf3-srv_10.42.42.10(pid=22639): Terminated {rc=256} 01:12:10.725433 --- ParallelTerminationStrategy: PID 22640 died... 01:12:10.745479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22640): Terminated: ok {rc=0} 01:12:10.791951 --- ParallelTerminationStrategy: PID 22641 died... 01:12:10.811892 run iperf3-srv_10.42.42.10(pid=22641): Terminated {rc=256} 01:12:10.858730 --- ParallelTerminationStrategy: PID 22642 died... 01:12:10.878643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22642): Terminated: ok {rc=0} 01:12:10.925219 --- ParallelTerminationStrategy: PID 22643 died... 01:12:10.945146 run iperf3-srv_10.42.42.10(pid=22643): Terminated {rc=256} 01:12:10.991627 --- ParallelTerminationStrategy: PID 22644 died... 01:12:11.011691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22644): Terminated: ok {rc=0} 01:12:11.058650 --- ParallelTerminationStrategy: PID 22645 died... 01:12:11.078709 run iperf3-srv_10.42.42.10(pid=22645): Terminated {rc=256} 01:12:11.125202 --- ParallelTerminationStrategy: PID 22648 died... 01:12:11.145205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22648): Terminated: ok {rc=0} 01:12:11.191897 --- ParallelTerminationStrategy: PID 22651 died... 01:12:11.212054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22651): Terminated: ok {rc=0} 01:12:11.258737 --- ParallelTerminationStrategy: PID 22654 died... 01:12:11.278924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22654): Terminated: ok {rc=0} 01:12:11.367642 bus /gobi_4: Setting Powered False 01:12:12.467056 bus /gobi_4: Setting Powered False 01:12:13.583495 bus /gobi_1: Setting Powered False 01:12:14.683338 bus /gobi_1: Setting Powered False 01:12:15.800359 bus /gobi_0: Setting Powered False 01:12:16.913907 bus /gobi_0: Setting Powered False 01:12:18.044596 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 01:12:19.149749 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:19.162038 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:12:19.216543 tst ping.py: using LAC 37510 01:12:19.342547 tst ping.py: using RAC 25 01:12:19.467927 tst ping.py: using CellId 37510 01:12:19.593665 tst ping.py: using BVCI 37511 01:12:19.703808 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:19.714794 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:19.725708 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:19.736258 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:19.747099 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:19.757804 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:19.768425 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:19.779696 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:12:19.898686 tst ping.py:19: start network... 01:12:20.117396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:12:20.616229 run create_hlr_db(pid=22657): Launched 01:12:20.741005 bus /gobi_6: Setting Powered False 01:12:21.805198 run create_hlr_db(pid=22657): Terminated: ok {rc=0} 01:12:22.257249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22659): Launched 01:12:22.581827 run osmo-hlr_10.42.42.2(pid=22660): Launched 01:12:22.707768 run osmo-stp_10.42.42.5: Starting osmo-stp 01:12:23.274021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22662): Launched 01:12:23.598931 run osmo-stp_10.42.42.5(pid=22663): Launched 01:12:23.721677 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:12:24.278734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22665): Launched 01:12:24.404299 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:12:24.678023 run patchelf(pid=22666): Launched 01:12:24.859709 run osmo-stp_10.42.42.5(pid=22663): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22663)] 01:12:24.997229 run osmo-stp_10.42.42.5(pid=22663): stdout: | (launched: 2022-12-14_01:12:23.538720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:25.136558 run osmo-stp_10.42.42.5(pid=22663): stderr: | [0;m[38;5;43m20221214011223729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011223729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011223729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011223730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011223730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011223730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011223730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:25.276018 run osmo-stp_10.42.42.5(pid=22663): stdout: | (launched: 2022-12-14_01:12:23.538720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:25.408652 run osmo-stp_10.42.42.5(pid=22663): stderr: | [0;m[38;5;43m20221214011223729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011223729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011223729 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011223730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011223730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011223730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011223730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:25.566164 run patchelf(pid=22666): Terminating (SIGINT) 01:12:25.746428 run patchelf(pid=22666): Terminated: ok {rc=0} 01:12:25.877262 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22663): Process ended prematurely: osmo-stp_10.42.42.5(pid=22663) [trial-2397↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22663)] [trial-2397↪gprs:trx-sysmocell5000↪ping.py:22] 01:12:25.886976 tst ping.py:22: Test FAILED (6.7 sec) 01:12:25.915487 run osmo-hlr_10.42.42.2(pid=22660): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22660)] 01:12:25.967009 run osmo-hlr_10.42.42.2(pid=22660): stdout: | (launched: 2022-12-14_01:12:22.522332) 01:12:26.019717 run osmo-hlr_10.42.42.2(pid=22660): stderr: | [0;m[1;31m20221214011222719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011222719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011222719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011222719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011222719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011222719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011222732 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011222740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011222740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011222740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:12:26.073291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22659): Terminating (SIGTERM) 01:12:26.115855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22662): Terminating (SIGTERM) 01:12:26.158720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22665): Terminating (SIGTERM) 01:12:26.202492 --- ParallelTerminationStrategy: PID 22659 died... 01:12:26.223182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22659): Terminated: ok {rc=0} 01:12:26.270488 --- ParallelTerminationStrategy: PID 22662 died... 01:12:26.290875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22662): Terminated: ok {rc=0} 01:12:26.338054 --- ParallelTerminationStrategy: PID 22665 died... 01:12:26.358179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22665): Terminated: ok {rc=0} 01:12:26.448510 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 01:12:27.537595 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:27.549270 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 01:12:27.600733 tst ping_idle_ping.py: using LAC 37511 01:12:27.720412 tst ping_idle_ping.py: using RAC 26 01:12:27.839693 tst ping_idle_ping.py: using CellId 37511 01:12:27.960303 tst ping_idle_ping.py: using BVCI 37512 01:12:28.071772 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:28.082779 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:28.093444 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:28.103917 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:28.114641 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:28.125462 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:28.136232 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 01:12:28.147011 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 01:12:28.262693 tst ping_idle_ping.py:24: start network... 01:12:28.464902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:12:28.935086 run create_hlr_db(pid=22667): Launched 01:12:29.060434 bus /gobi_6: Setting Powered False 01:12:30.121461 run create_hlr_db(pid=22667): Terminated: ok {rc=0} 01:12:30.567767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22669): Launched 01:12:30.914125 run osmo-hlr_10.42.42.2(pid=22670): Launched 01:12:31.163374 run osmo-stp_10.42.42.5: Starting osmo-stp 01:12:31.801549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22672): Launched 01:12:32.135270 run osmo-stp_10.42.42.5(pid=22673): Launched 01:12:32.361060 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:12:32.883281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22675): Launched 01:12:32.998743 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:12:33.253779 run patchelf(pid=22676): Launched 01:12:33.422627 run osmo-stp_10.42.42.5(pid=22673): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22673)] 01:12:33.550820 run osmo-stp_10.42.42.5(pid=22673): stdout: | (launched: 2022-12-14_01:12:32.076157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:33.680807 run osmo-stp_10.42.42.5(pid=22673): stderr: | [0;m[38;5;43m20221214011232302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011232303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011232303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011232303 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011232304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011232306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011232307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:33.811368 run osmo-stp_10.42.42.5(pid=22673): stdout: | (launched: 2022-12-14_01:12:32.076157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:33.935542 run osmo-stp_10.42.42.5(pid=22673): stderr: | [0;m[38;5;43m20221214011232302 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011232303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011232303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011232303 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011232304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011232306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011232307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:34.082661 run patchelf(pid=22676): Terminating (SIGINT) 01:12:34.253353 run patchelf(pid=22676): Terminated: ok {rc=0} 01:12:34.375557 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22673): Process ended prematurely: osmo-stp_10.42.42.5(pid=22673) [trial-2397↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22673)] [trial-2397↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 01:12:34.384603 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 01:12:34.411451 run osmo-hlr_10.42.42.2(pid=22670): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22670)] 01:12:34.460304 run osmo-hlr_10.42.42.2(pid=22670): stdout: | (launched: 2022-12-14_01:12:30.839153) 01:12:34.510271 run osmo-hlr_10.42.42.2(pid=22670): stderr: | [0;m[1;31m20221214011231156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011231156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011231156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011231156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011231156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011231156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011231171 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011231187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011231187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011231187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:12:34.560674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22669): Terminating (SIGTERM) 01:12:34.600766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22672): Terminating (SIGTERM) 01:12:34.640212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22675): Terminating (SIGTERM) 01:12:34.680002 --- ParallelTerminationStrategy: PID 22669 died... 01:12:34.699358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22669): Terminated: ok {rc=0} 01:12:34.743393 --- ParallelTerminationStrategy: PID 22672 died... 01:12:34.762259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22672): Terminated: ok {rc=0} 01:12:34.806072 --- ParallelTerminationStrategy: PID 22675 died... 01:12:34.825038 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22675): Terminated: ok {rc=0} 01:12:34.911365 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 01:12:36.225147 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:12:36.230987 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:12:36.264914 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:12:36.303667 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:12:36.390133 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:12:36.423509 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:12:36.461630 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:12:37.055746 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:12:37.105291 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:37.116410 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:12:37.167161 tst cs_paging_gprs_active.py: using LAC 37512 01:12:37.289154 tst cs_paging_gprs_active.py: using RAC 27 01:12:37.410492 tst cs_paging_gprs_active.py: using CellId 37512 01:12:37.531952 tst cs_paging_gprs_active.py: using BVCI 37513 01:12:37.644813 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:37.655889 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:37.666749 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:37.677979 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:37.688738 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:37.699751 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:37.710892 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:37.721809 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:37.732788 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:12:37.853693 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:12:37.971997 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:12:38.178878 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:38.487914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22680): Launched 01:12:38.756891 run iperf3-srv_10.42.42.10(pid=22681): Launched 01:12:38.872464 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:12:39.078250 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:39.386894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22682): Launched 01:12:39.657786 run iperf3-srv_10.42.42.10(pid=22683): Launched 01:12:39.773863 tst cs_paging_gprs_active.py:38: start network... 01:12:39.981390 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:12:40.461248 run create_hlr_db(pid=22684): Launched 01:12:40.587542 bus /gobi_6: Setting Powered False 01:12:41.648322 run create_hlr_db(pid=22684): Terminated: ok {rc=0} 01:12:42.098853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22686): Launched 01:12:42.430713 run osmo-hlr_10.42.42.2(pid=22687): Launched 01:12:42.559220 run osmo-stp_10.42.42.5: Starting osmo-stp 01:12:43.128731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22689): Launched 01:12:43.458904 run osmo-stp_10.42.42.5(pid=22690): Launched 01:12:43.586792 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:12:44.157424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22692): Launched 01:12:44.285482 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:12:44.564826 run patchelf(pid=22693): Launched 01:12:44.750740 run osmo-stp_10.42.42.5(pid=22690): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22690)] 01:12:44.891909 run osmo-stp_10.42.42.5(pid=22690): stdout: | (launched: 2022-12-14_01:12:43.398509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:45.033350 run osmo-stp_10.42.42.5(pid=22690): stderr: | [0;m[38;5;43m20221214011243590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011243591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011243591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011243591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011243592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011243592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011243592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:45.174761 run osmo-stp_10.42.42.5(pid=22690): stdout: | (launched: 2022-12-14_01:12:43.398509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:45.310240 run osmo-stp_10.42.42.5(pid=22690): stderr: | [0;m[38;5;43m20221214011243590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011243591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011243591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011243591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011243592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011243592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011243592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:45.470540 run patchelf(pid=22693): Terminating (SIGINT) 01:12:45.655597 run patchelf(pid=22693): Terminated: ok {rc=0} 01:12:45.788684 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22690): Process ended prematurely: osmo-stp_10.42.42.5(pid=22690) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22690)] [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:12:45.799113 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 01:12:45.830272 run osmo-hlr_10.42.42.2(pid=22687): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22687)] 01:12:45.900564 run osmo-hlr_10.42.42.2(pid=22687): stdout: | (launched: 2022-12-14_01:12:42.370377) 01:12:45.964602 run osmo-hlr_10.42.42.2(pid=22687): stderr: | [0;m[1;31m20221214011242566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011242566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011242566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011242566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011242566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011242566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011242579 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011242589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011242589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011242589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:12:46.018819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22680): Terminating (SIGTERM) 01:12:46.066276 run iperf3-srv_10.42.42.10(pid=22681): Terminating (SIGTERM) 01:12:46.112105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22682): Terminating (SIGTERM) 01:12:46.155959 run iperf3-srv_10.42.42.10(pid=22683): Terminating (SIGTERM) 01:12:46.202083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22686): Terminating (SIGTERM) 01:12:46.245746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22689): Terminating (SIGTERM) 01:12:46.290008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22692): Terminating (SIGTERM) 01:12:46.333384 --- ParallelTerminationStrategy: PID 22680 died... 01:12:46.354062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22680): Terminated: ok {rc=0} 01:12:46.401342 --- ParallelTerminationStrategy: PID 22681 died... 01:12:46.421833 run iperf3-srv_10.42.42.10(pid=22681): Terminated {rc=256} 01:12:46.468822 --- ParallelTerminationStrategy: PID 22682 died... 01:12:46.489414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22682): Terminated: ok {rc=0} 01:12:46.536551 --- ParallelTerminationStrategy: PID 22683 died... 01:12:46.557165 run iperf3-srv_10.42.42.10(pid=22683): Terminated {rc=256} 01:12:46.605082 --- ParallelTerminationStrategy: PID 22686 died... 01:12:46.626366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22686): Terminated: ok {rc=0} 01:12:46.674169 --- ParallelTerminationStrategy: PID 22689 died... 01:12:46.695216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22689): Terminated: ok {rc=0} 01:12:46.743072 --- ParallelTerminationStrategy: PID 22692 died... 01:12:46.764062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22692): Terminated: ok {rc=0} 01:12:46.855104 bus /gobi_0: Setting Powered False 01:12:47.956423 bus /gobi_0: Setting Powered False 01:12:49.073078 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:12:50.222741 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:50.235239 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:12:50.292120 tst iperf3.py: using LAC 37513 01:12:50.422648 tst iperf3.py: using RAC 28 01:12:50.544478 tst iperf3.py: using CellId 37513 01:12:50.665909 tst iperf3.py: using BVCI 37514 01:12:50.776132 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:50.787372 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:50.798412 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:50.809392 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:50.820297 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:50.831327 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:50.842420 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:50.853072 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:50.864217 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:12:50.983453 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:12:51.188258 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:12:51.495308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22694): Launched 01:12:51.762614 run iperf3-srv_10.42.42.10(pid=22695): Launched 01:12:51.879152 tst iperf3.py:8: start network... 01:12:52.083298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:12:52.557167 run create_hlr_db(pid=22696): Launched 01:12:52.684493 bus /gobi_6: Setting Powered False 01:12:53.745503 run create_hlr_db(pid=22696): Terminated: ok {rc=0} 01:12:54.194974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22698): Launched 01:12:54.526704 run osmo-hlr_10.42.42.2(pid=22699): Launched 01:12:54.654070 run osmo-stp_10.42.42.5: Starting osmo-stp 01:12:55.228670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22701): Launched 01:12:55.559497 run osmo-stp_10.42.42.5(pid=22702): Launched 01:12:55.684801 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:12:56.252716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22704): Launched 01:12:56.379350 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:12:56.658019 run patchelf(pid=22705): Launched 01:12:56.844143 run osmo-stp_10.42.42.5(pid=22702): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22702)] 01:12:56.984327 run osmo-stp_10.42.42.5(pid=22702): stdout: | (launched: 2022-12-14_01:12:55.498323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:57.126253 run osmo-stp_10.42.42.5(pid=22702): stderr: | [0;m[38;5;43m20221214011255690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011255690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011255690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011255690 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011255691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011255691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011255691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:57.268712 run osmo-stp_10.42.42.5(pid=22702): stdout: | (launched: 2022-12-14_01:12:55.498323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:12:57.404009 run osmo-stp_10.42.42.5(pid=22702): stderr: | [0;m[38;5;43m20221214011255690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011255690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011255690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011255690 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011255691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011255691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011255691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:12:57.564590 run patchelf(pid=22705): Terminating (SIGINT) 01:12:57.748871 run patchelf(pid=22705): Terminated: ok {rc=0} 01:12:57.882824 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22702): Process ended prematurely: osmo-stp_10.42.42.5(pid=22702) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22702)] [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 01:12:57.893144 tst iperf3.py:8: Test FAILED (7.7 sec) 01:12:57.921686 run osmo-hlr_10.42.42.2(pid=22699): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22699)] 01:12:57.972242 run osmo-hlr_10.42.42.2(pid=22699): stdout: | (launched: 2022-12-14_01:12:54.466590) 01:12:58.024406 run osmo-hlr_10.42.42.2(pid=22699): stderr: | [0;m[1;31m20221214011254664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011254664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011254664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011254664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011254664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011254664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011254677 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011254685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011254686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011254686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:12:58.076848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22694): Terminating (SIGTERM) 01:12:58.118403 run iperf3-srv_10.42.42.10(pid=22695): Terminating (SIGTERM) 01:12:58.160870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22698): Terminating (SIGTERM) 01:12:58.203777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22701): Terminating (SIGTERM) 01:12:58.246443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22704): Terminating (SIGTERM) 01:12:58.289593 --- ParallelTerminationStrategy: PID 22694 died... 01:12:58.310305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22694): Terminated: ok {rc=0} 01:12:58.357522 --- ParallelTerminationStrategy: PID 22695 died... 01:12:58.377721 run iperf3-srv_10.42.42.10(pid=22695): Terminated {rc=256} 01:12:58.424731 --- ParallelTerminationStrategy: PID 22698 died... 01:12:58.445037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22698): Terminated: ok {rc=0} 01:12:58.491960 --- ParallelTerminationStrategy: PID 22701 died... 01:12:58.512332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22701): Terminated: ok {rc=0} 01:12:58.559003 --- ParallelTerminationStrategy: PID 22704 died... 01:12:58.579396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22704): Terminated: ok {rc=0} 01:12:58.669895 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:12:59.819211 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:12:59.831093 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:12:59.880908 tst iperf3m4.py: using LAC 37514 01:12:59.999916 tst iperf3m4.py: using RAC 29 01:13:00.118927 tst iperf3m4.py: using CellId 37514 01:13:00.238646 tst iperf3m4.py: using BVCI 37515 01:13:00.350769 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:00.362174 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:00.373086 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:00.383941 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:00.394826 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:00.405781 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:00.416793 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:00.428223 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:00.439485 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:13:00.560238 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:13:00.680152 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:13:00.801862 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:13:00.924911 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:13:01.147219 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:01.464766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22706): Launched 01:13:01.753357 run iperf3-srv_10.42.42.10(pid=22707): Launched 01:13:01.886819 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:13:02.098642 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:02.414056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22708): Launched 01:13:02.683333 run iperf3-srv_10.42.42.10(pid=22709): Launched 01:13:02.798202 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:13:03.003557 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:03.311945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22710): Launched 01:13:03.580186 run iperf3-srv_10.42.42.10(pid=22711): Launched 01:13:03.695417 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:13:03.900537 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:04.209083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22712): Launched 01:13:04.478128 run iperf3-srv_10.42.42.10(pid=22713): Launched 01:13:04.595614 tst iperf3m4.py:8: start network... 01:13:04.800128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:13:05.274981 run create_hlr_db(pid=22714): Launched 01:13:05.403114 bus /gobi_6: Setting Powered False 01:13:06.463751 run create_hlr_db(pid=22714): Terminated: ok {rc=0} 01:13:06.892539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22716): Launched 01:13:07.199911 run osmo-hlr_10.42.42.2(pid=22717): Launched 01:13:07.316849 run osmo-stp_10.42.42.5: Starting osmo-stp 01:13:07.861916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22719): Launched 01:13:08.171863 run osmo-stp_10.42.42.5(pid=22720): Launched 01:13:08.289343 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:13:08.820325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22722): Launched 01:13:08.940626 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:13:09.200838 run patchelf(pid=22723): Launched 01:13:09.374009 run osmo-stp_10.42.42.5(pid=22720): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22720)] 01:13:09.503744 run osmo-stp_10.42.42.5(pid=22720): stdout: | (launched: 2022-12-14_01:13:08.114694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:09.635777 run osmo-stp_10.42.42.5(pid=22720): stderr: | [0;m[38;5;43m20221214011308283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011308284 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011308284 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011308284 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011308285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011308285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011308285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:09.767859 run osmo-stp_10.42.42.5(pid=22720): stdout: | (launched: 2022-12-14_01:13:08.114694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:09.893354 run osmo-stp_10.42.42.5(pid=22720): stderr: | [0;m[38;5;43m20221214011308283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011308284 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011308284 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011308284 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011308285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011308285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011308285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:10.042212 run patchelf(pid=22723): Terminating (SIGINT) 01:13:10.213837 run patchelf(pid=22723): Terminated: ok {rc=0} 01:13:10.338003 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22720): Process ended prematurely: osmo-stp_10.42.42.5(pid=22720) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22720)] [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 01:13:10.347497 tst iperf3m4.py:8: Test FAILED (10.6 sec) 01:13:10.375077 run osmo-hlr_10.42.42.2(pid=22717): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22717)] 01:13:10.423041 run osmo-hlr_10.42.42.2(pid=22717): stdout: | (launched: 2022-12-14_01:13:07.143060) 01:13:10.472331 run osmo-hlr_10.42.42.2(pid=22717): stderr: | [0;m[1;31m20221214011307319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011307319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011307319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011307319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011307319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011307319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011307331 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011307339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011307339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011307339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:13:10.522899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22706): Terminating (SIGTERM) 01:13:10.562828 run iperf3-srv_10.42.42.10(pid=22707): Terminating (SIGTERM) 01:13:10.602475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22708): Terminating (SIGTERM) 01:13:10.642464 run iperf3-srv_10.42.42.10(pid=22709): Terminating (SIGTERM) 01:13:10.682100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22710): Terminating (SIGTERM) 01:13:10.721770 run iperf3-srv_10.42.42.10(pid=22711): Terminating (SIGTERM) 01:13:10.761423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22712): Terminating (SIGTERM) 01:13:10.801272 run iperf3-srv_10.42.42.10(pid=22713): Terminating (SIGTERM) 01:13:10.840906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22716): Terminating (SIGTERM) 01:13:10.880727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22719): Terminating (SIGTERM) 01:13:10.920465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22722): Terminating (SIGTERM) 01:13:10.960581 --- ParallelTerminationStrategy: PID 22706 died... 01:13:10.980044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22706): Terminated: ok {rc=0} 01:13:11.024424 --- ParallelTerminationStrategy: PID 22707 died... 01:13:11.043399 run iperf3-srv_10.42.42.10(pid=22707): Terminated {rc=256} 01:13:11.087612 --- ParallelTerminationStrategy: PID 22708 died... 01:13:11.106577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22708): Terminated: ok {rc=0} 01:13:11.151019 --- ParallelTerminationStrategy: PID 22709 died... 01:13:11.169985 run iperf3-srv_10.42.42.10(pid=22709): Terminated {rc=256} 01:13:11.213971 --- ParallelTerminationStrategy: PID 22710 died... 01:13:11.232932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22710): Terminated: ok {rc=0} 01:13:11.277238 --- ParallelTerminationStrategy: PID 22711 died... 01:13:11.296061 run iperf3-srv_10.42.42.10(pid=22711): Terminated {rc=256} 01:13:11.340292 --- ParallelTerminationStrategy: PID 22712 died... 01:13:11.359355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22712): Terminated: ok {rc=0} 01:13:11.404008 --- ParallelTerminationStrategy: PID 22713 died... 01:13:11.423092 run iperf3-srv_10.42.42.10(pid=22713): Terminated {rc=256} 01:13:11.467168 --- ParallelTerminationStrategy: PID 22716 died... 01:13:11.486128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22716): Terminated: ok {rc=0} 01:13:11.530390 --- ParallelTerminationStrategy: PID 22719 died... 01:13:11.549328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22719): Terminated: ok {rc=0} 01:13:11.593289 --- ParallelTerminationStrategy: PID 22722 died... 01:13:11.611905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22722): Terminated: ok {rc=0} 01:13:11.696781 bus /gobi_4: Setting Powered False 01:13:12.795684 bus /gobi_4: Setting Powered False 01:13:13.915287 bus /gobi_1: Setting Powered False 01:13:15.015844 bus /gobi_1: Setting Powered False 01:13:16.138441 bus /gobi_0: Setting Powered False 01:13:17.254428 bus /gobi_0: Setting Powered False 01:13:18.372925 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 01:13:19.477328 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:19.489871 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:13:19.544087 tst ping.py: using LAC 37515 01:13:19.677425 tst ping.py: using RAC 30 01:13:19.803259 tst ping.py: using CellId 37515 01:13:19.928065 tst ping.py: using BVCI 37516 01:13:20.045162 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:20.056732 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:20.068237 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:20.079573 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:20.091410 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:20.103007 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:20.114873 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:20.126628 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:13:20.243307 tst ping.py:19: start network... 01:13:20.443686 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:13:20.910264 run create_hlr_db(pid=22724): Launched 01:13:21.034792 bus /gobi_6: Setting Powered False 01:13:22.095222 run create_hlr_db(pid=22724): Terminated: ok {rc=0} 01:13:22.516538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22726): Launched 01:13:22.818027 run osmo-hlr_10.42.42.2(pid=22727): Launched 01:13:22.931483 run osmo-stp_10.42.42.5: Starting osmo-stp 01:13:23.449104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22729): Launched 01:13:23.749110 run osmo-stp_10.42.42.5(pid=22730): Launched 01:13:23.863688 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:13:24.381993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22732): Launched 01:13:24.497102 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:13:24.751783 run patchelf(pid=22733): Launched 01:13:24.919203 run osmo-stp_10.42.42.5(pid=22730): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22730)] 01:13:25.046174 run osmo-stp_10.42.42.5(pid=22730): stdout: | (launched: 2022-12-14_01:13:23.693266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:25.174978 run osmo-stp_10.42.42.5(pid=22730): stderr: | [0;m[38;5;43m20221214011323863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011323863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011323863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011323864 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011323864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011323864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011323864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:25.304063 run osmo-stp_10.42.42.5(pid=22730): stdout: | (launched: 2022-12-14_01:13:23.693266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:25.426447 run osmo-stp_10.42.42.5(pid=22730): stderr: | [0;m[38;5;43m20221214011323863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011323863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011323863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011323864 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011323864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011323864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011323864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:25.571584 run patchelf(pid=22733): Terminating (SIGINT) 01:13:25.739151 run patchelf(pid=22733): Terminated: ok {rc=0} 01:13:25.860571 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22730): Process ended prematurely: osmo-stp_10.42.42.5(pid=22730) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22730)] [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 01:13:25.869488 tst ping.py:22: Test FAILED (6.4 sec) 01:13:25.896240 run osmo-hlr_10.42.42.2(pid=22727): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22727)] 01:13:25.943851 run osmo-hlr_10.42.42.2(pid=22727): stdout: | (launched: 2022-12-14_01:13:22.762113) 01:13:25.993354 run osmo-hlr_10.42.42.2(pid=22727): stderr: | [0;m[1;31m20221214011322936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011322936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011322936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011322936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011322936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011322936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011322949 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011322958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011322958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011322958 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:13:26.043295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22726): Terminating (SIGTERM) 01:13:26.083240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22729): Terminating (SIGTERM) 01:13:26.123107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22732): Terminating (SIGTERM) 01:13:26.163146 --- ParallelTerminationStrategy: PID 22726 died... 01:13:26.182078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22726): Terminated: ok {rc=0} 01:13:26.226221 --- ParallelTerminationStrategy: PID 22729 died... 01:13:26.244737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22729): Terminated: ok {rc=0} 01:13:26.288773 --- ParallelTerminationStrategy: PID 22732 died... 01:13:26.307468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22732): Terminated: ok {rc=0} 01:13:26.393581 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:13:27.484322 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:27.496774 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:13:27.552647 tst ping_idle_ping.py: using LAC 37516 01:13:27.681406 tst ping_idle_ping.py: using RAC 31 01:13:27.808445 tst ping_idle_ping.py: using CellId 37516 01:13:27.936199 tst ping_idle_ping.py: using BVCI 37517 01:13:28.046605 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:28.058032 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:28.068928 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:28.079815 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:28.090655 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:28.101454 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:28.112521 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:13:28.123450 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:13:28.243828 tst ping_idle_ping.py:24: start network... 01:13:28.463977 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:13:28.969558 run create_hlr_db(pid=22734): Launched 01:13:29.095081 bus /gobi_6: Setting Powered False 01:13:30.160252 run create_hlr_db(pid=22734): Terminated: ok {rc=0} 01:13:30.597571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22736): Launched 01:13:30.929753 run osmo-hlr_10.42.42.2(pid=22737): Launched 01:13:31.209523 run osmo-stp_10.42.42.5: Starting osmo-stp 01:13:31.881525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22739): Launched 01:13:32.207664 run osmo-stp_10.42.42.5(pid=22740): Launched 01:13:32.349256 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:13:32.872520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22742): Launched 01:13:32.988259 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:13:33.242970 run patchelf(pid=22743): Launched 01:13:33.412878 run osmo-stp_10.42.42.5(pid=22740): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22740)] 01:13:33.540370 run osmo-stp_10.42.42.5(pid=22740): stdout: | (launched: 2022-12-14_01:13:32.150223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:33.670543 run osmo-stp_10.42.42.5(pid=22740): stderr: | [0;m[38;5;43m20221214011332356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011332356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011332356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011332357 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011332357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011332357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011332357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:33.800084 run osmo-stp_10.42.42.5(pid=22740): stdout: | (launched: 2022-12-14_01:13:32.150223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:33.923626 run osmo-stp_10.42.42.5(pid=22740): stderr: | [0;m[38;5;43m20221214011332356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011332356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011332356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011332357 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011332357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011332357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011332357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:34.070492 run patchelf(pid=22743): Terminating (SIGINT) 01:13:34.239258 run patchelf(pid=22743): Terminated: ok {rc=0} 01:13:34.360835 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22740): Process ended prematurely: osmo-stp_10.42.42.5(pid=22740) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22740)] [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 01:13:34.369901 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 01:13:34.396693 run osmo-hlr_10.42.42.2(pid=22737): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22737)] 01:13:34.444336 run osmo-hlr_10.42.42.2(pid=22737): stdout: | (launched: 2022-12-14_01:13:30.853121) 01:13:34.493523 run osmo-hlr_10.42.42.2(pid=22737): stderr: | [0;m[1;31m20221214011331200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011331200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011331200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011331200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011331200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011331201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011331220 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011331233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011331234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011331234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:13:34.543094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22736): Terminating (SIGTERM) 01:13:34.582737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22739): Terminating (SIGTERM) 01:13:34.622230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22742): Terminating (SIGTERM) 01:13:34.662000 --- ParallelTerminationStrategy: PID 22736 died... 01:13:34.681313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22736): Terminated: ok {rc=0} 01:13:34.725827 --- ParallelTerminationStrategy: PID 22739 died... 01:13:34.744471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22739): Terminated: ok {rc=0} 01:13:34.788631 --- ParallelTerminationStrategy: PID 22742 died... 01:13:34.807503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22742): Terminated: ok {rc=0} 01:13:34.894369 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:13:36.206628 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:13:36.213076 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:13:36.246678 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:13:36.285359 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:13:36.373486 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:13:36.410033 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:13:36.450712 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:13:37.039107 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:13:37.089598 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:37.100754 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:13:37.170896 tst cs_paging_gprs_active.py: using LAC 37517 01:13:37.293309 tst cs_paging_gprs_active.py: using RAC 32 01:13:37.413308 tst cs_paging_gprs_active.py: using CellId 37517 01:13:37.534428 tst cs_paging_gprs_active.py: using BVCI 37518 01:13:37.647154 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:37.658213 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:37.669067 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:37.679885 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:37.690948 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:37.701912 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:37.712790 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:37.723515 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:37.734507 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:13:37.853400 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:13:37.974965 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:13:38.199146 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:38.530129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22747): Launched 01:13:38.818511 run iperf3-srv_10.42.42.10(pid=22748): Launched 01:13:38.943154 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:13:39.166449 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:39.498450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22749): Launched 01:13:39.786809 run iperf3-srv_10.42.42.10(pid=22750): Launched 01:13:39.912164 tst cs_paging_gprs_active.py:38: start network... 01:13:40.135918 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:13:40.646213 run create_hlr_db(pid=22751): Launched 01:13:40.774648 bus /gobi_6: Setting Powered False 01:13:41.839731 run create_hlr_db(pid=22751): Terminated: ok {rc=0} 01:13:42.299129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22753): Launched 01:13:42.628710 run osmo-hlr_10.42.42.2(pid=22754): Launched 01:13:42.757034 run osmo-stp_10.42.42.5: Starting osmo-stp 01:13:43.329445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22756): Launched 01:13:43.660437 run osmo-stp_10.42.42.5(pid=22757): Launched 01:13:43.789087 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:13:44.358993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22759): Launched 01:13:44.486158 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:13:44.765249 run patchelf(pid=22760): Launched 01:13:44.951397 run osmo-stp_10.42.42.5(pid=22757): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22757)] 01:13:45.091826 run osmo-stp_10.42.42.5(pid=22757): stdout: | (launched: 2022-12-14_01:13:43.599986) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:45.232857 run osmo-stp_10.42.42.5(pid=22757): stderr: | [0;m[38;5;43m20221214011343793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011343793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011343793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011343794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011343794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011343794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011343794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:45.374064 run osmo-stp_10.42.42.5(pid=22757): stdout: | (launched: 2022-12-14_01:13:43.599986) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:45.508802 run osmo-stp_10.42.42.5(pid=22757): stderr: | [0;m[38;5;43m20221214011343793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011343793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011343793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011343794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011343794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011343794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011343794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:45.668780 run patchelf(pid=22760): Terminating (SIGINT) 01:13:45.879852 run patchelf(pid=22760): Terminated: ok {rc=0} 01:13:46.013413 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22757): Process ended prematurely: osmo-stp_10.42.42.5(pid=22757) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22757)] [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:13:46.027464 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 01:13:46.063918 run osmo-hlr_10.42.42.2(pid=22754): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22754)] 01:13:46.116737 run osmo-hlr_10.42.42.2(pid=22754): stdout: | (launched: 2022-12-14_01:13:42.568172) 01:13:46.171732 run osmo-hlr_10.42.42.2(pid=22754): stderr: | [0;m[1;31m20221214011342766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011342766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011342766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011342766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011342766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011342766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011342781 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011342789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011342789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011342789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:13:46.226627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22747): Terminating (SIGTERM) 01:13:46.270852 run iperf3-srv_10.42.42.10(pid=22748): Terminating (SIGTERM) 01:13:46.318069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22749): Terminating (SIGTERM) 01:13:46.362595 run iperf3-srv_10.42.42.10(pid=22750): Terminating (SIGTERM) 01:13:46.406579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22753): Terminating (SIGTERM) 01:13:46.451199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22756): Terminating (SIGTERM) 01:13:46.501634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22759): Terminating (SIGTERM) 01:13:46.556569 --- ParallelTerminationStrategy: PID 22747 died... 01:13:46.582306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22747): Terminated: ok {rc=0} 01:13:46.640330 --- ParallelTerminationStrategy: PID 22748 died... 01:13:46.661719 run iperf3-srv_10.42.42.10(pid=22748): Terminated {rc=256} 01:13:46.717762 --- ParallelTerminationStrategy: PID 22749 died... 01:13:46.741704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22749): Terminated: ok {rc=0} 01:13:46.799365 --- ParallelTerminationStrategy: PID 22750 died... 01:13:46.823442 run iperf3-srv_10.42.42.10(pid=22750): Terminated {rc=256} 01:13:46.877664 --- ParallelTerminationStrategy: PID 22753 died... 01:13:46.901850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22753): Terminated: ok {rc=0} 01:13:46.957800 --- ParallelTerminationStrategy: PID 22756 died... 01:13:46.983331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22756): Terminated: ok {rc=0} 01:13:47.037593 --- ParallelTerminationStrategy: PID 22759 died... 01:13:47.061639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22759): Terminated: ok {rc=0} 01:13:47.170768 bus /gobi_0: Setting Powered False 01:13:48.280788 bus /gobi_0: Setting Powered False 01:13:49.401863 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:13:50.549618 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:50.561707 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:13:50.635820 tst iperf3.py: using LAC 37518 01:13:50.756288 tst iperf3.py: using RAC 33 01:13:50.877396 tst iperf3.py: using CellId 37518 01:13:51.000289 tst iperf3.py: using BVCI 37519 01:13:51.113364 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:51.124401 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:51.135254 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:51.146156 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:51.156934 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:51.167843 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:51.178839 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:51.189639 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:51.200620 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:13:51.322572 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:13:51.545402 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:13:51.877106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22761): Launched 01:13:52.166307 run iperf3-srv_10.42.42.10(pid=22762): Launched 01:13:52.289969 tst iperf3.py:8: start network... 01:13:52.512289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:13:53.025440 run create_hlr_db(pid=22763): Launched 01:13:53.153349 bus /gobi_6: Setting Powered False 01:13:54.218100 run create_hlr_db(pid=22763): Terminated: ok {rc=0} 01:13:54.663475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22765): Launched 01:13:54.977016 run osmo-hlr_10.42.42.2(pid=22766): Launched 01:13:55.093855 run osmo-stp_10.42.42.5: Starting osmo-stp 01:13:55.624348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22768): Launched 01:13:55.932101 run osmo-stp_10.42.42.5(pid=22769): Launched 01:13:56.048533 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:13:56.577073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22771): Launched 01:13:56.695128 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:13:56.955431 run patchelf(pid=22772): Launched 01:13:57.126703 run osmo-stp_10.42.42.5(pid=22769): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22769)] 01:13:57.256717 run osmo-stp_10.42.42.5(pid=22769): stdout: | (launched: 2022-12-14_01:13:55.875087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:57.389148 run osmo-stp_10.42.42.5(pid=22769): stderr: | [0;m[38;5;43m20221214011356045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011356045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011356046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011356046 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011356047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011356047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011356047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:57.522182 run osmo-stp_10.42.42.5(pid=22769): stdout: | (launched: 2022-12-14_01:13:55.875087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:13:57.648065 run osmo-stp_10.42.42.5(pid=22769): stderr: | [0;m[38;5;43m20221214011356045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011356045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011356046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011356046 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011356047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011356047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011356047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:13:57.797153 run patchelf(pid=22772): Terminating (SIGINT) 01:13:57.969277 run patchelf(pid=22772): Terminated: ok {rc=0} 01:13:58.093696 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22769): Process ended prematurely: osmo-stp_10.42.42.5(pid=22769) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22769)] [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 01:13:58.103235 tst iperf3.py:8: Test FAILED (7.6 sec) 01:13:58.130571 run osmo-hlr_10.42.42.2(pid=22766): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22766)] 01:13:58.178488 run osmo-hlr_10.42.42.2(pid=22766): stdout: | (launched: 2022-12-14_01:13:54.919752) 01:13:58.228003 run osmo-hlr_10.42.42.2(pid=22766): stderr: | [0;m[1;31m20221214011355094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011355095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011355095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011355095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011355095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011355095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011355107 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011355117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011355117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011355117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:13:58.278225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22761): Terminating (SIGTERM) 01:13:58.318520 run iperf3-srv_10.42.42.10(pid=22762): Terminating (SIGTERM) 01:13:58.358477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22765): Terminating (SIGTERM) 01:13:58.398538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22768): Terminating (SIGTERM) 01:13:58.438508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22771): Terminating (SIGTERM) 01:13:58.478806 --- ParallelTerminationStrategy: PID 22761 died... 01:13:58.498268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22761): Terminated: ok {rc=0} 01:13:58.542694 --- ParallelTerminationStrategy: PID 22762 died... 01:13:58.561681 run iperf3-srv_10.42.42.10(pid=22762): Terminated {rc=256} 01:13:58.605802 --- ParallelTerminationStrategy: PID 22765 died... 01:13:58.624791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22765): Terminated: ok {rc=0} 01:13:58.669262 --- ParallelTerminationStrategy: PID 22768 died... 01:13:58.688387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22768): Terminated: ok {rc=0} 01:13:58.732743 --- ParallelTerminationStrategy: PID 22771 died... 01:13:58.751858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22771): Terminated: ok {rc=0} 01:13:58.838889 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:13:59.986896 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:13:59.998940 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:14:00.071981 tst iperf3m4.py: using LAC 37519 01:14:00.193198 tst iperf3m4.py: using RAC 34 01:14:00.313585 tst iperf3m4.py: using CellId 37519 01:14:00.434579 tst iperf3m4.py: using BVCI 37520 01:14:00.547620 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:00.558809 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:00.569838 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:00.580701 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:00.591777 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:00.602831 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:00.614088 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:00.625086 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:00.636218 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:14:00.760011 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:14:00.887856 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:14:01.037956 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:14:01.186552 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:14:01.424864 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:01.782333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22773): Launched 01:14:02.087130 run iperf3-srv_10.42.42.10(pid=22774): Launched 01:14:02.227429 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:14:02.451609 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:02.784890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22775): Launched 01:14:03.074875 run iperf3-srv_10.42.42.10(pid=22776): Launched 01:14:03.199720 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:14:03.422404 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:03.754705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22777): Launched 01:14:04.043231 run iperf3-srv_10.42.42.10(pid=22778): Launched 01:14:04.168215 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:14:04.390503 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:04.722982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22779): Launched 01:14:05.012598 run iperf3-srv_10.42.42.10(pid=22780): Launched 01:14:05.137911 tst iperf3m4.py:8: start network... 01:14:05.360259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:14:05.872668 run create_hlr_db(pid=22781): Launched 01:14:06.000730 bus /gobi_6: Setting Powered False 01:14:07.065955 run create_hlr_db(pid=22781): Terminated: ok {rc=0} 01:14:07.524153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22783): Launched 01:14:07.855130 run osmo-hlr_10.42.42.2(pid=22784): Launched 01:14:07.983283 run osmo-stp_10.42.42.5: Starting osmo-stp 01:14:08.548617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22786): Launched 01:14:08.878955 run osmo-stp_10.42.42.5(pid=22787): Launched 01:14:09.006647 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:14:09.571474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22789): Launched 01:14:09.699604 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:14:09.977685 run patchelf(pid=22790): Launched 01:14:10.161083 run osmo-stp_10.42.42.5(pid=22787): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22787)] 01:14:10.300072 run osmo-stp_10.42.42.5(pid=22787): stdout: | (launched: 2022-12-14_01:14:08.818805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:10.441496 run osmo-stp_10.42.42.5(pid=22787): stderr: | [0;m[38;5;43m20221214011409010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011409010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011409010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011409011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011409011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011409011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011409011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:10.583338 run osmo-stp_10.42.42.5(pid=22787): stdout: | (launched: 2022-12-14_01:14:08.818805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:10.718025 run osmo-stp_10.42.42.5(pid=22787): stderr: | [0;m[38;5;43m20221214011409010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011409010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011409010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011409011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011409011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011409011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011409011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:10.877461 run patchelf(pid=22790): Terminating (SIGINT) 01:14:11.062266 run patchelf(pid=22790): Terminated: ok {rc=0} 01:14:11.195266 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22787): Process ended prematurely: osmo-stp_10.42.42.5(pid=22787) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22787)] [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:14:11.205678 tst iperf3m4.py:8: Test FAILED (11.3 sec) 01:14:11.234483 run osmo-hlr_10.42.42.2(pid=22784): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22784)] 01:14:11.284929 run osmo-hlr_10.42.42.2(pid=22784): stdout: | (launched: 2022-12-14_01:14:07.794754) 01:14:11.336702 run osmo-hlr_10.42.42.2(pid=22784): stderr: | [0;m[1;31m20221214011407991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011407991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011407991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011407991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011407991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011407992 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011408027 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011408037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011408037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011408037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:14:11.388875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22773): Terminating (SIGTERM) 01:14:11.430897 run iperf3-srv_10.42.42.10(pid=22774): Terminating (SIGTERM) 01:14:11.472940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22775): Terminating (SIGTERM) 01:14:11.515402 run iperf3-srv_10.42.42.10(pid=22776): Terminating (SIGTERM) 01:14:11.557772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22777): Terminating (SIGTERM) 01:14:11.599890 run iperf3-srv_10.42.42.10(pid=22778): Terminating (SIGTERM) 01:14:11.642327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22779): Terminating (SIGTERM) 01:14:11.684406 run iperf3-srv_10.42.42.10(pid=22780): Terminating (SIGTERM) 01:14:11.726922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22783): Terminating (SIGTERM) 01:14:11.768791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22786): Terminating (SIGTERM) 01:14:11.811121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22789): Terminating (SIGTERM) 01:14:11.853197 --- ParallelTerminationStrategy: PID 22773 died... 01:14:11.873429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22773): Terminated: ok {rc=0} 01:14:11.921031 --- ParallelTerminationStrategy: PID 22774 died... 01:14:11.941976 run iperf3-srv_10.42.42.10(pid=22774): Terminated {rc=256} 01:14:11.989240 --- ParallelTerminationStrategy: PID 22775 died... 01:14:12.008817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22775): Terminated: ok {rc=0} 01:14:12.055326 --- ParallelTerminationStrategy: PID 22776 died... 01:14:12.075141 run iperf3-srv_10.42.42.10(pid=22776): Terminated {rc=256} 01:14:12.120861 --- ParallelTerminationStrategy: PID 22777 died... 01:14:12.141216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22777): Terminated: ok {rc=0} 01:14:12.187487 --- ParallelTerminationStrategy: PID 22778 died... 01:14:12.207220 run iperf3-srv_10.42.42.10(pid=22778): Terminated {rc=256} 01:14:12.253194 --- ParallelTerminationStrategy: PID 22779 died... 01:14:12.272922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22779): Terminated: ok {rc=0} 01:14:12.319433 --- ParallelTerminationStrategy: PID 22780 died... 01:14:12.339263 run iperf3-srv_10.42.42.10(pid=22780): Terminated {rc=256} 01:14:12.385257 --- ParallelTerminationStrategy: PID 22783 died... 01:14:12.405172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22783): Terminated: ok {rc=0} 01:14:12.451616 --- ParallelTerminationStrategy: PID 22786 died... 01:14:12.471473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22786): Terminated: ok {rc=0} 01:14:12.517884 --- ParallelTerminationStrategy: PID 22789 died... 01:14:12.537809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22789): Terminated: ok {rc=0} 01:14:12.626308 bus /gobi_4: Setting Powered False 01:14:13.724501 bus /gobi_4: Setting Powered False 01:14:14.841683 bus /gobi_1: Setting Powered False 01:14:15.954466 bus /gobi_1: Setting Powered False 01:14:17.086361 bus /gobi_0: Setting Powered False 01:14:18.188137 bus /gobi_0: Setting Powered False 01:14:19.307390 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:14:20.411758 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:20.423764 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:14:20.495285 tst ping.py: using LAC 37520 01:14:20.614504 tst ping.py: using RAC 35 01:14:20.732912 tst ping.py: using CellId 37520 01:14:20.853279 tst ping.py: using BVCI 37521 01:14:20.974525 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:20.986282 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:20.998055 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:21.009946 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:21.022365 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:21.034885 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:21.047351 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:21.059663 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:14:21.183045 tst ping.py:19: start network... 01:14:21.400826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:14:21.898687 run create_hlr_db(pid=22792): Launched 01:14:22.023566 bus /gobi_6: Setting Powered False 01:14:23.087204 run create_hlr_db(pid=22792): Terminated: ok {rc=0} 01:14:23.518133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22794): Launched 01:14:23.819496 run osmo-hlr_10.42.42.2(pid=22795): Launched 01:14:23.934630 run osmo-stp_10.42.42.5: Starting osmo-stp 01:14:24.453913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22797): Launched 01:14:24.754651 run osmo-stp_10.42.42.5(pid=22798): Launched 01:14:24.870634 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:14:25.391331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22800): Launched 01:14:25.506918 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:14:25.760695 run patchelf(pid=22801): Launched 01:14:25.927918 run osmo-stp_10.42.42.5(pid=22798): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22798)] 01:14:26.055906 run osmo-stp_10.42.42.5(pid=22798): stdout: | (launched: 2022-12-14_01:14:24.699000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:26.185261 run osmo-stp_10.42.42.5(pid=22798): stderr: | [0;m[38;5;43m20221214011424869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011424870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011424870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011424870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011424871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011424871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011424871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:26.314210 run osmo-stp_10.42.42.5(pid=22798): stdout: | (launched: 2022-12-14_01:14:24.699000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:26.436702 run osmo-stp_10.42.42.5(pid=22798): stderr: | [0;m[38;5;43m20221214011424869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011424870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011424870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011424870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011424871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011424871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011424871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:26.582494 run patchelf(pid=22801): Terminating (SIGINT) 01:14:26.750158 run patchelf(pid=22801): Terminated: ok {rc=0} 01:14:26.871333 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22798): Process ended prematurely: osmo-stp_10.42.42.5(pid=22798) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22798)] [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 01:14:26.880332 tst ping.py:22: Test FAILED (6.5 sec) 01:14:26.907252 run osmo-hlr_10.42.42.2(pid=22795): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22795)] 01:14:26.955220 run osmo-hlr_10.42.42.2(pid=22795): stdout: | (launched: 2022-12-14_01:14:23.764147) 01:14:27.005129 run osmo-hlr_10.42.42.2(pid=22795): stderr: | [0;m[1;31m20221214011423936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011423936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011423936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011423936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011423936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011423936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011423976 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011423986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011423986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011423986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:14:27.055088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22794): Terminating (SIGTERM) 01:14:27.095118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22797): Terminating (SIGTERM) 01:14:27.135808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22800): Terminating (SIGTERM) 01:14:27.176182 --- ParallelTerminationStrategy: PID 22794 died... 01:14:27.195494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22794): Terminated: ok {rc=0} 01:14:27.239646 --- ParallelTerminationStrategy: PID 22797 died... 01:14:27.258719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22797): Terminated: ok {rc=0} 01:14:27.302774 --- ParallelTerminationStrategy: PID 22800 died... 01:14:27.321518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22800): Terminated: ok {rc=0} 01:14:27.407015 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:14:28.496834 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:28.509563 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:14:28.584409 tst ping_idle_ping.py: using LAC 37521 01:14:28.716489 tst ping_idle_ping.py: using RAC 36 01:14:28.846511 tst ping_idle_ping.py: using CellId 37521 01:14:28.972662 tst ping_idle_ping.py: using BVCI 37522 01:14:29.084214 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:29.095476 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:29.106479 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:29.117396 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:29.128625 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:29.140457 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:29.152216 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:14:29.163668 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:14:29.280077 tst ping_idle_ping.py:24: start network... 01:14:29.482917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:14:29.957488 run create_hlr_db(pid=22802): Launched 01:14:30.082630 bus /gobi_6: Setting Powered False 01:14:31.159168 run create_hlr_db(pid=22802): Terminated: ok {rc=0} 01:14:31.661130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22804): Launched 01:14:31.986833 run osmo-hlr_10.42.42.2(pid=22805): Launched 01:14:32.231863 run osmo-stp_10.42.42.5: Starting osmo-stp 01:14:32.799084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22807): Launched 01:14:33.124782 run osmo-stp_10.42.42.5(pid=22808): Launched 01:14:33.248601 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:14:33.805692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22810): Launched 01:14:33.930952 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:14:34.205698 run patchelf(pid=22811): Launched 01:14:34.387103 run osmo-stp_10.42.42.5(pid=22808): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22808)] 01:14:34.524477 run osmo-stp_10.42.42.5(pid=22808): stdout: | (launched: 2022-12-14_01:14:33.065218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:34.663775 run osmo-stp_10.42.42.5(pid=22808): stderr: | [0;m[38;5;43m20221214011433256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011433256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011433256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011433257 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011433257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011433257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011433257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:34.803271 run osmo-stp_10.42.42.5(pid=22808): stdout: | (launched: 2022-12-14_01:14:33.065218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:34.936822 run osmo-stp_10.42.42.5(pid=22808): stderr: | [0;m[38;5;43m20221214011433256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011433256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011433256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011433257 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011433257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011433257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011433257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:35.094668 run patchelf(pid=22811): Terminating (SIGINT) 01:14:35.276238 run patchelf(pid=22811): Terminated: ok {rc=0} 01:14:35.407134 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22808): Process ended prematurely: osmo-stp_10.42.42.5(pid=22808) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22808)] [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:14:35.417053 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 01:14:35.444863 run osmo-hlr_10.42.42.2(pid=22805): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22805)] 01:14:35.495605 run osmo-hlr_10.42.42.2(pid=22805): stdout: | (launched: 2022-12-14_01:14:31.930133) 01:14:35.547676 run osmo-hlr_10.42.42.2(pid=22805): stderr: | [0;m[1;31m20221214011432222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011432222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011432222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011432222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011432222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011432223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011432239 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011432247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011432248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011432248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:14:35.599947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22804): Terminating (SIGTERM) 01:14:35.642059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22807): Terminating (SIGTERM) 01:14:35.684556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22810): Terminating (SIGTERM) 01:14:35.726839 --- ParallelTerminationStrategy: PID 22804 died... 01:14:35.747145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22804): Terminated: ok {rc=0} 01:14:35.792915 --- ParallelTerminationStrategy: PID 22807 died... 01:14:35.813351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22807): Terminated: ok {rc=0} 01:14:35.859706 --- ParallelTerminationStrategy: PID 22810 died... 01:14:35.879647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22810): Terminated: ok {rc=0} 01:14:35.968380 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:14:37.272359 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:14:37.280604 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:14:37.315999 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 01:14:37.355685 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 01:14:37.446048 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:14:37.480822 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 01:14:37.520603 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 01:14:38.119418 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 01:14:38.173749 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:38.185560 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:14:38.259449 tst cs_paging_gprs_active.py: using LAC 37522 01:14:38.392739 tst cs_paging_gprs_active.py: using RAC 37 01:14:38.521374 tst cs_paging_gprs_active.py: using CellId 37522 01:14:38.648421 tst cs_paging_gprs_active.py: using BVCI 37523 01:14:38.768245 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:38.780007 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:38.791636 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:38.803204 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:38.815136 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:38.826811 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:38.838837 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:38.850713 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:38.862772 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:14:38.981411 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:14:39.104088 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:14:39.328048 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:39.659661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22816): Launched 01:14:39.951846 run iperf3-srv_10.42.42.10(pid=22817): Launched 01:14:40.078500 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:14:40.302594 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:40.635311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22818): Launched 01:14:40.926688 run iperf3-srv_10.42.42.10(pid=22819): Launched 01:14:41.052742 tst cs_paging_gprs_active.py:38: start network... 01:14:41.276200 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:14:41.787322 run create_hlr_db(pid=22820): Launched 01:14:41.915086 bus /gobi_6: Setting Powered False 01:14:42.979146 run create_hlr_db(pid=22820): Terminated: ok {rc=0} 01:14:43.418603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22822): Launched 01:14:43.726594 run osmo-hlr_10.42.42.2(pid=22823): Launched 01:14:43.844046 run osmo-stp_10.42.42.5: Starting osmo-stp 01:14:44.372384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22825): Launched 01:14:44.679488 run osmo-stp_10.42.42.5(pid=22826): Launched 01:14:44.795640 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:14:45.326356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22828): Launched 01:14:45.444184 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:14:45.703980 run patchelf(pid=22829): Launched 01:14:45.876197 run osmo-stp_10.42.42.5(pid=22826): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22826)] 01:14:46.029678 run osmo-stp_10.42.42.5(pid=22826): stdout: | (launched: 2022-12-14_01:14:44.622814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:46.210179 run osmo-stp_10.42.42.5(pid=22826): stderr: | [0;m[38;5;43m20221214011444794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011444794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011444794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011444794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011444795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011444795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011444795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:46.344241 run osmo-stp_10.42.42.5(pid=22826): stdout: | (launched: 2022-12-14_01:14:44.622814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:46.472165 run osmo-stp_10.42.42.5(pid=22826): stderr: | [0;m[38;5;43m20221214011444794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011444794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011444794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011444794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011444795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011444795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011444795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:46.623961 run patchelf(pid=22829): Terminating (SIGINT) 01:14:46.799443 run patchelf(pid=22829): Terminated: ok {rc=0} 01:14:46.926089 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22826): Process ended prematurely: osmo-stp_10.42.42.5(pid=22826) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22826)] [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 01:14:46.936264 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:14:46.964329 run osmo-hlr_10.42.42.2(pid=22823): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22823)] 01:14:47.013335 run osmo-hlr_10.42.42.2(pid=22823): stdout: | (launched: 2022-12-14_01:14:43.669700) 01:14:47.063697 run osmo-hlr_10.42.42.2(pid=22823): stderr: | [0;m[1;31m20221214011443843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011443843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011443843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011443843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011443843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011443843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011443867 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011443876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011443877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011443877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:14:47.114694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22816): Terminating (SIGTERM) 01:14:47.156047 run iperf3-srv_10.42.42.10(pid=22817): Terminating (SIGTERM) 01:14:47.199295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22818): Terminating (SIGTERM) 01:14:47.240657 run iperf3-srv_10.42.42.10(pid=22819): Terminating (SIGTERM) 01:14:47.281676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22822): Terminating (SIGTERM) 01:14:47.321955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22825): Terminating (SIGTERM) 01:14:47.361801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22828): Terminating (SIGTERM) 01:14:47.401585 --- ParallelTerminationStrategy: PID 22816 died... 01:14:47.420804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22816): Terminated: ok {rc=0} 01:14:47.464931 --- ParallelTerminationStrategy: PID 22817 died... 01:14:47.484142 run iperf3-srv_10.42.42.10(pid=22817): Terminated {rc=256} 01:14:47.528142 --- ParallelTerminationStrategy: PID 22818 died... 01:14:47.546956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22818): Terminated: ok {rc=0} 01:14:47.590779 --- ParallelTerminationStrategy: PID 22819 died... 01:14:47.609460 run iperf3-srv_10.42.42.10(pid=22819): Terminated {rc=256} 01:14:47.653427 --- ParallelTerminationStrategy: PID 22822 died... 01:14:47.672192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22822): Terminated: ok {rc=0} 01:14:47.716333 --- ParallelTerminationStrategy: PID 22825 died... 01:14:47.735043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22825): Terminated: ok {rc=0} 01:14:47.779009 --- ParallelTerminationStrategy: PID 22828 died... 01:14:47.798170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22828): Terminated: ok {rc=0} 01:14:47.884374 bus /gobi_0: Setting Powered False 01:14:48.985557 bus /gobi_0: Setting Powered False 01:14:50.101911 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 01:14:51.249357 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:51.261169 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:14:51.335709 tst iperf3.py: using LAC 37523 01:14:51.466819 tst iperf3.py: using RAC 38 01:14:51.597476 tst iperf3.py: using CellId 37523 01:14:51.728057 tst iperf3.py: using BVCI 37524 01:14:51.847669 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:51.859415 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:51.871059 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:51.882510 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:51.894251 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:51.905960 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:51.918091 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:51.929831 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:14:51.941692 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:14:52.058727 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:14:52.265851 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:14:52.576289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22830): Launched 01:14:52.847110 run iperf3-srv_10.42.42.10(pid=22831): Launched 01:14:52.964581 tst iperf3.py:8: start network... 01:14:53.171179 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:14:53.649791 run create_hlr_db(pid=22832): Launched 01:14:53.776284 bus /gobi_6: Setting Powered False 01:14:54.837935 run create_hlr_db(pid=22832): Terminated: ok {rc=0} 01:14:55.288797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22834): Launched 01:14:55.619422 run osmo-hlr_10.42.42.2(pid=22835): Launched 01:14:55.746552 run osmo-stp_10.42.42.5: Starting osmo-stp 01:14:56.320633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22837): Launched 01:14:56.651413 run osmo-stp_10.42.42.5(pid=22838): Launched 01:14:56.779177 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:14:57.349776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22840): Launched 01:14:57.477052 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:14:57.756361 run patchelf(pid=22841): Launched 01:14:57.941666 run osmo-stp_10.42.42.5(pid=22838): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22838)] 01:14:58.081518 run osmo-stp_10.42.42.5(pid=22838): stdout: | (launched: 2022-12-14_01:14:56.591140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:58.223664 run osmo-stp_10.42.42.5(pid=22838): stderr: | [0;m[38;5;43m20221214011456783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011456783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011456783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011456783 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011456784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011456784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011456784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:58.365484 run osmo-stp_10.42.42.5(pid=22838): stdout: | (launched: 2022-12-14_01:14:56.591140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:14:58.500507 run osmo-stp_10.42.42.5(pid=22838): stderr: | [0;m[38;5;43m20221214011456783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011456783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011456783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011456783 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011456784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011456784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011456784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:14:58.660536 run patchelf(pid=22841): Terminating (SIGINT) 01:14:58.845406 run patchelf(pid=22841): Terminated: ok {rc=0} 01:14:58.979296 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22838): Process ended prematurely: osmo-stp_10.42.42.5(pid=22838) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22838)] [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 01:14:58.989656 tst iperf3.py:8: Test FAILED (7.8 sec) 01:14:59.018445 run osmo-hlr_10.42.42.2(pid=22835): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22835)] 01:14:59.069569 run osmo-hlr_10.42.42.2(pid=22835): stdout: | (launched: 2022-12-14_01:14:55.559181) 01:14:59.122486 run osmo-hlr_10.42.42.2(pid=22835): stderr: | [0;m[1;31m20221214011455756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011455756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011455756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011455756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011455756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011455756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011455769 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011455780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011455780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011455780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:14:59.175554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22830): Terminating (SIGTERM) 01:14:59.218380 run iperf3-srv_10.42.42.10(pid=22831): Terminating (SIGTERM) 01:14:59.260835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22834): Terminating (SIGTERM) 01:14:59.303371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22837): Terminating (SIGTERM) 01:14:59.345887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22840): Terminating (SIGTERM) 01:14:59.388795 --- ParallelTerminationStrategy: PID 22830 died... 01:14:59.409495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22830): Terminated: ok {rc=0} 01:14:59.456268 --- ParallelTerminationStrategy: PID 22831 died... 01:14:59.476412 run iperf3-srv_10.42.42.10(pid=22831): Terminated {rc=256} 01:14:59.523159 --- ParallelTerminationStrategy: PID 22834 died... 01:14:59.543180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22834): Terminated: ok {rc=0} 01:14:59.590157 --- ParallelTerminationStrategy: PID 22837 died... 01:14:59.610498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22837): Terminated: ok {rc=0} 01:14:59.657369 --- ParallelTerminationStrategy: PID 22840 died... 01:14:59.677571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22840): Terminated: ok {rc=0} 01:14:59.767109 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 01:15:00.934685 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:00.947584 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:15:01.030723 tst iperf3m4.py: using LAC 37524 01:15:01.154369 tst iperf3m4.py: using RAC 39 01:15:01.310889 tst iperf3m4.py: using CellId 37524 01:15:01.442051 tst iperf3m4.py: using BVCI 37525 01:15:01.566011 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:01.578775 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:01.591359 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:01.604100 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:01.617880 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:01.632414 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:01.646244 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:01.658822 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:01.673821 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:15:01.800529 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:15:01.933739 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:15:02.063362 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:15:02.211814 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:15:02.439636 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:15:02.772378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22845): Launched 01:15:03.062822 run iperf3-srv_10.42.42.10(pid=22846): Launched 01:15:03.188085 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:15:03.410752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:15:03.742389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22847): Launched 01:15:04.030572 run iperf3-srv_10.42.42.10(pid=22848): Launched 01:15:04.155711 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:15:04.377396 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:15:04.707915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22849): Launched 01:15:04.998252 run iperf3-srv_10.42.42.10(pid=22850): Launched 01:15:05.122143 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:15:05.343656 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:15:05.674663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22851): Launched 01:15:05.962541 run iperf3-srv_10.42.42.10(pid=22852): Launched 01:15:06.087670 tst iperf3m4.py:8: start network... 01:15:06.309651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:15:06.818484 run create_hlr_db(pid=22853): Launched 01:15:06.946891 bus /gobi_6: Setting Powered False 01:15:08.011990 run create_hlr_db(pid=22853): Terminated: ok {rc=0} 01:15:08.470047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22855): Launched 01:15:08.798897 run osmo-hlr_10.42.42.2(pid=22856): Launched 01:15:08.926460 run osmo-stp_10.42.42.5: Starting osmo-stp 01:15:09.493367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22858): Launched 01:15:09.825493 run osmo-stp_10.42.42.5(pid=22859): Launched 01:15:09.951789 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:15:10.520464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22861): Launched 01:15:10.648229 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:15:10.926040 run patchelf(pid=22863): Launched 01:15:11.108718 run osmo-stp_10.42.42.5(pid=22859): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22859)] 01:15:11.247611 run osmo-stp_10.42.42.5(pid=22859): stdout: | (launched: 2022-12-14_01:15:09.764500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:11.388171 run osmo-stp_10.42.42.5(pid=22859): stderr: | [0;m[38;5;43m20221214011509955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011509955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011509955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011509955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011509956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011509956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011509956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:11.528783 run osmo-stp_10.42.42.5(pid=22859): stdout: | (launched: 2022-12-14_01:15:09.764500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:11.662804 run osmo-stp_10.42.42.5(pid=22859): stderr: | [0;m[38;5;43m20221214011509955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011509955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011509955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011509955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011509956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011509956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011509956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:11.821917 run patchelf(pid=22863): Terminating (SIGINT) 01:15:12.005872 run patchelf(pid=22863): Terminated: ok {rc=0} 01:15:12.138387 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22859): Process ended prematurely: osmo-stp_10.42.42.5(pid=22859) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22859)] [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 01:15:12.148842 tst iperf3m4.py:8: Test FAILED (11.3 sec) 01:15:12.177937 run osmo-hlr_10.42.42.2(pid=22856): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22856)] 01:15:12.229357 run osmo-hlr_10.42.42.2(pid=22856): stdout: | (launched: 2022-12-14_01:15:08.738384) 01:15:12.281796 run osmo-hlr_10.42.42.2(pid=22856): stderr: | [0;m[1;31m20221214011508935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011508935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011508935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011508935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011508935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011508935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011508947 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011508955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011508956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011508956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:15:12.334939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22845): Terminating (SIGTERM) 01:15:12.377713 run iperf3-srv_10.42.42.10(pid=22846): Terminating (SIGTERM) 01:15:12.420730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22847): Terminating (SIGTERM) 01:15:12.463465 run iperf3-srv_10.42.42.10(pid=22848): Terminating (SIGTERM) 01:15:12.505915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22849): Terminating (SIGTERM) 01:15:12.548520 run iperf3-srv_10.42.42.10(pid=22850): Terminating (SIGTERM) 01:15:12.590978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22851): Terminating (SIGTERM) 01:15:12.633602 run iperf3-srv_10.42.42.10(pid=22852): Terminating (SIGTERM) 01:15:12.675948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22855): Terminating (SIGTERM) 01:15:12.718425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22858): Terminating (SIGTERM) 01:15:12.761393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22861): Terminating (SIGTERM) 01:15:12.804093 --- ParallelTerminationStrategy: PID 22845 died... 01:15:12.824645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22845): Terminated: ok {rc=0} 01:15:12.871493 --- ParallelTerminationStrategy: PID 22846 died... 01:15:12.891312 run iperf3-srv_10.42.42.10(pid=22846): Terminated {rc=256} 01:15:12.937555 --- ParallelTerminationStrategy: PID 22847 died... 01:15:12.957330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22847): Terminated: ok {rc=0} 01:15:13.003688 --- ParallelTerminationStrategy: PID 22848 died... 01:15:13.023493 run iperf3-srv_10.42.42.10(pid=22848): Terminated {rc=256} 01:15:13.069270 --- ParallelTerminationStrategy: PID 22849 died... 01:15:13.088808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22849): Terminated: ok {rc=0} 01:15:13.135278 --- ParallelTerminationStrategy: PID 22850 died... 01:15:13.155058 run iperf3-srv_10.42.42.10(pid=22850): Terminated {rc=256} 01:15:13.201349 --- ParallelTerminationStrategy: PID 22851 died... 01:15:13.221255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22851): Terminated: ok {rc=0} 01:15:13.267671 --- ParallelTerminationStrategy: PID 22852 died... 01:15:13.287593 run iperf3-srv_10.42.42.10(pid=22852): Terminated {rc=256} 01:15:13.333898 --- ParallelTerminationStrategy: PID 22855 died... 01:15:13.353858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22855): Terminated: ok {rc=0} 01:15:13.400430 --- ParallelTerminationStrategy: PID 22858 died... 01:15:13.420408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22858): Terminated: ok {rc=0} 01:15:13.466851 --- ParallelTerminationStrategy: PID 22861 died... 01:15:13.486983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22861): Terminated: ok {rc=0} 01:15:13.576125 bus /gobi_4: Setting Powered False 01:15:14.675642 bus /gobi_4: Setting Powered False 01:15:15.793866 bus /gobi_1: Setting Powered False 01:15:16.905268 bus /gobi_1: Setting Powered False 01:15:18.027806 bus /gobi_0: Setting Powered False 01:15:19.126948 bus /gobi_0: Setting Powered False 01:15:20.245178 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 01:15:21.350492 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:21.363119 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:15:21.442156 tst ping.py: using LAC 37525 01:15:21.569485 tst ping.py: using RAC 40 01:15:21.694903 tst ping.py: using CellId 37525 01:15:21.819590 tst ping.py: using BVCI 37526 01:15:21.930400 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:21.941791 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:21.952870 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:21.963965 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:21.974742 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:21.985888 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:21.996803 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:22.007661 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:15:22.128182 tst ping.py:19: start network... 01:15:22.328804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:15:22.793146 run create_hlr_db(pid=22864): Launched 01:15:22.915995 bus /gobi_6: Setting Powered False 01:15:23.975434 run create_hlr_db(pid=22864): Terminated: ok {rc=0} 01:15:24.395944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22866): Launched 01:15:24.696297 run osmo-hlr_10.42.42.2(pid=22867): Launched 01:15:24.810738 run osmo-stp_10.42.42.5: Starting osmo-stp 01:15:25.331920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22869): Launched 01:15:25.633654 run osmo-stp_10.42.42.5(pid=22870): Launched 01:15:25.748006 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:15:26.267207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22872): Launched 01:15:26.382436 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:15:26.635522 run patchelf(pid=22873): Launched 01:15:26.802909 run osmo-stp_10.42.42.5(pid=22870): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22870)] 01:15:26.930030 run osmo-stp_10.42.42.5(pid=22870): stdout: | (launched: 2022-12-14_01:15:25.576683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:27.059479 run osmo-stp_10.42.42.5(pid=22870): stderr: | [0;m[38;5;43m20221214011525746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011525746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011525747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011525747 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011525748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011525748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011525748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:27.188443 run osmo-stp_10.42.42.5(pid=22870): stdout: | (launched: 2022-12-14_01:15:25.576683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:27.310937 run osmo-stp_10.42.42.5(pid=22870): stderr: | [0;m[38;5;43m20221214011525746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011525746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011525747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011525747 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011525748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011525748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011525748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:27.456086 run patchelf(pid=22873): Terminating (SIGINT) 01:15:27.624781 run patchelf(pid=22873): Terminated: ok {rc=0} 01:15:27.745745 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22870): Process ended prematurely: osmo-stp_10.42.42.5(pid=22870) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22870)] [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 01:15:27.754594 tst ping.py:22: Test FAILED (6.4 sec) 01:15:27.781276 run osmo-hlr_10.42.42.2(pid=22867): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22867)] 01:15:27.829275 run osmo-hlr_10.42.42.2(pid=22867): stdout: | (launched: 2022-12-14_01:15:24.640685) 01:15:27.878207 run osmo-hlr_10.42.42.2(pid=22867): stderr: | [0;m[1;31m20221214011524815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011524815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011524815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011524815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011524815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011524815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011524827 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011524837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011524837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011524837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:15:27.927594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22866): Terminating (SIGTERM) 01:15:27.967431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22869): Terminating (SIGTERM) 01:15:28.007006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22872): Terminating (SIGTERM) 01:15:28.046788 --- ParallelTerminationStrategy: PID 22866 died... 01:15:28.066069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22866): Terminated: ok {rc=0} 01:15:28.110232 --- ParallelTerminationStrategy: PID 22869 died... 01:15:28.129175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22869): Terminated: ok {rc=0} 01:15:28.172931 --- ParallelTerminationStrategy: PID 22872 died... 01:15:28.191932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22872): Terminated: ok {rc=0} 01:15:28.278381 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 01:15:29.366922 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:29.379263 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:15:29.452082 tst ping_idle_ping.py: using LAC 37526 01:15:29.569591 tst ping_idle_ping.py: using RAC 41 01:15:29.688171 tst ping_idle_ping.py: using CellId 37526 01:15:29.806012 tst ping_idle_ping.py: using BVCI 37527 01:15:29.916231 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:29.927319 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:29.938265 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:29.949275 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:29.960067 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:29.970972 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:29.981991 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:15:29.992912 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:15:30.112664 tst ping_idle_ping.py:24: start network... 01:15:30.332073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:15:30.847625 run create_hlr_db(pid=22874): Launched 01:15:31.025468 bus /gobi_6: Setting Powered False 01:15:32.106904 run create_hlr_db(pid=22874): Terminated: ok {rc=0} 01:15:32.557225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22876): Launched 01:15:32.859346 run osmo-hlr_10.42.42.2(pid=22877): Launched 01:15:32.973619 run osmo-stp_10.42.42.5: Starting osmo-stp 01:15:33.504619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22879): Launched 01:15:33.807663 run osmo-stp_10.42.42.5(pid=22880): Launched 01:15:33.922804 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:15:34.443607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22882): Launched 01:15:34.559568 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:15:34.814734 run patchelf(pid=22883): Launched 01:15:34.985040 run osmo-stp_10.42.42.5(pid=22880): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22880)] 01:15:35.112577 run osmo-stp_10.42.42.5(pid=22880): stdout: | (launched: 2022-12-14_01:15:33.751720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:35.242721 run osmo-stp_10.42.42.5(pid=22880): stderr: | [0;m[38;5;43m20221214011533920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011533920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011533920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011533920 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011533921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011533921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011533921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:35.372667 run osmo-stp_10.42.42.5(pid=22880): stdout: | (launched: 2022-12-14_01:15:33.751720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:35.496196 run osmo-stp_10.42.42.5(pid=22880): stderr: | [0;m[38;5;43m20221214011533920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011533920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011533920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011533920 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011533921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011533921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011533921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:35.642878 run patchelf(pid=22883): Terminating (SIGINT) 01:15:35.812018 run patchelf(pid=22883): Terminated: ok {rc=0} 01:15:35.933505 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22880): Process ended prematurely: osmo-stp_10.42.42.5(pid=22880) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22880)] [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 01:15:35.942521 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 01:15:35.969247 run osmo-hlr_10.42.42.2(pid=22877): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22877)] 01:15:36.016761 run osmo-hlr_10.42.42.2(pid=22877): stdout: | (launched: 2022-12-14_01:15:32.802825) 01:15:36.066017 run osmo-hlr_10.42.42.2(pid=22877): stderr: | [0;m[1;31m20221214011532978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011532978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011532978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011532978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011532978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011532979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011532992 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011533003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011533003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011533003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:15:36.115846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22876): Terminating (SIGTERM) 01:15:36.155527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22879): Terminating (SIGTERM) 01:15:36.195131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22882): Terminating (SIGTERM) 01:15:36.235234 --- ParallelTerminationStrategy: PID 22876 died... 01:15:36.254537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22876): Terminated: ok {rc=0} 01:15:36.298607 --- ParallelTerminationStrategy: PID 22879 died... 01:15:36.317463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22879): Terminated: ok {rc=0} 01:15:36.361311 --- ParallelTerminationStrategy: PID 22882 died... 01:15:36.379906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22882): Terminated: ok {rc=0} 01:15:36.463678 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:15:37.770714 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:15:37.777514 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:15:37.810740 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:15:37.845254 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:15:37.897794 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:15:37.931050 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:15:37.965269 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:15:38.529226 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2397 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:15:38.534495 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:38.546340 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:15:38.619901 tst switch_tch_pdch.py: using LAC 37527 01:15:38.751800 tst switch_tch_pdch.py: using RAC 42 01:15:38.878702 tst switch_tch_pdch.py: using CellId 37527 01:15:39.004148 tst switch_tch_pdch.py: using BVCI 37528 01:15:39.122828 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:39.134739 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:39.146468 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:39.158221 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:39.170332 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:39.182431 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:39.194582 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:15:39.206575 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:15:39.325260 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:15:39.445569 tst switch_tch_pdch.py:51: start network... 01:15:39.663274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:15:40.164256 run create_hlr_db(pid=22887): Launched 01:15:40.289195 bus /gobi_6: Setting Powered False 01:15:41.353281 run create_hlr_db(pid=22887): Terminated: ok {rc=0} 01:15:41.806721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22889): Launched 01:15:42.134260 run osmo-hlr_10.42.42.2(pid=22890): Launched 01:15:42.261082 run osmo-stp_10.42.42.5: Starting osmo-stp 01:15:42.819805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22892): Launched 01:15:43.145971 run osmo-stp_10.42.42.5(pid=22893): Launched 01:15:43.270861 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:15:43.828205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22895): Launched 01:15:43.954258 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:15:44.227375 run patchelf(pid=22896): Launched 01:15:44.408683 run osmo-stp_10.42.42.5(pid=22893): ERR: Terminated: ERROR {rc=1} [trial-2397↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22893)] 01:15:44.544900 run osmo-stp_10.42.42.5(pid=22893): stdout: | (launched: 2022-12-14_01:15:43.086644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:44.683272 run osmo-stp_10.42.42.5(pid=22893): stderr: | [0;m[38;5;43m20221214011543278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011543278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011543279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011543279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011543279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011543279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011543280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:44.822028 run osmo-stp_10.42.42.5(pid=22893): stdout: | (launched: 2022-12-14_01:15:43.086644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:44.954221 run osmo-stp_10.42.42.5(pid=22893): stderr: | [0;m[38;5;43m20221214011543278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011543278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011543279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011543279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011543279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011543279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011543280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:45.110862 run patchelf(pid=22896): Terminating (SIGINT) 01:15:45.290546 run patchelf(pid=22896): Terminated: ok {rc=0} 01:15:45.420302 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22893): Process ended prematurely: osmo-stp_10.42.42.5(pid=22893) [trial-2397↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22893)] [trial-2397↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:15:45.430098 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 01:15:45.458090 run osmo-hlr_10.42.42.2(pid=22890): ERR: Terminated: ERROR {rc=237} [trial-2397↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22890)] 01:15:45.508670 run osmo-hlr_10.42.42.2(pid=22890): stdout: | (launched: 2022-12-14_01:15:42.073646) 01:15:45.561312 run osmo-hlr_10.42.42.2(pid=22890): stderr: | [0;m[1;31m20221214011542270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011542270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011542270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011542270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011542270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011542270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011542286 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011542294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011542294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011542294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:15:45.614057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22889): Terminating (SIGTERM) 01:15:45.656080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22892): Terminating (SIGTERM) 01:15:45.698662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22895): Terminating (SIGTERM) 01:15:45.741172 --- ParallelTerminationStrategy: PID 22889 died... 01:15:45.761961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22889): Terminated: ok {rc=0} 01:15:45.809069 --- ParallelTerminationStrategy: PID 22892 died... 01:15:45.830002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22892): Terminated: ok {rc=0} 01:15:45.885590 --- ParallelTerminationStrategy: PID 22895 died... 01:15:45.906843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22895): Terminated: ok {rc=0} 01:15:46.006541 bus /gobi_0: Setting Powered False 01:15:47.123138 bus /gobi_0: Setting Powered False 01:15:48.250548 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 01:15:49.511547 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:15:49.518234 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 01:15:49.553856 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 01:15:49.589612 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 01:15:49.646934 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 01:15:49.680629 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 01:15:49.714803 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 01:15:50.268694 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2397 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 01:15:50.274118 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:15:50.285415 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 01:15:50.357963 tst switch_tch_pdch.py: using LAC 37528 01:15:50.485795 tst switch_tch_pdch.py: using RAC 43 01:15:50.612068 tst switch_tch_pdch.py: using CellId 37528 01:15:50.740213 tst switch_tch_pdch.py: using BVCI 37529 01:15:50.857779 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:15:50.869417 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:15:50.880800 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:15:50.892256 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:15:50.903979 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:15:50.915657 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:15:50.927551 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:15:50.939331 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:15:51.059753 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:15:51.176908 tst switch_tch_pdch.py:51: start network... 01:15:51.379391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:15:51.821082 run create_hlr_db(pid=22900): Launched 01:15:51.947131 bus /gobi_6: Setting Powered False 01:15:53.007437 run create_hlr_db(pid=22900): Terminated: ok {rc=0} 01:15:53.403838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22906): Launched 01:15:53.704840 run osmo-hlr_10.42.42.2(pid=22907): Launched 01:15:53.819307 run osmo-stp_10.42.42.5: Starting osmo-stp 01:15:54.313080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22909): Launched 01:15:54.613476 run osmo-stp_10.42.42.5(pid=22910): Launched 01:15:54.727867 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:15:55.224274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22912): Launched 01:15:55.339728 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:15:55.594202 run patchelf(pid=22913): Launched 01:15:55.761592 run osmo-stp_10.42.42.5(pid=22910): ERR: Terminated: ERROR {rc=1} [trial-2397↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22910)] 01:15:55.889314 run osmo-stp_10.42.42.5(pid=22910): stdout: | (launched: 2022-12-14_01:15:54.557673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:56.018327 run osmo-stp_10.42.42.5(pid=22910): stderr: | [0;m[38;5;43m20221214011554726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011554726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011554727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011554727 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011554728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011554728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011554728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:56.147602 run osmo-stp_10.42.42.5(pid=22910): stdout: | (launched: 2022-12-14_01:15:54.557673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:15:56.269895 run osmo-stp_10.42.42.5(pid=22910): stderr: | [0;m[38;5;43m20221214011554726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011554726 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011554727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011554727 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011554728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011554728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011554728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:15:56.415313 run patchelf(pid=22913): Terminating (SIGINT) 01:15:56.583643 run patchelf(pid=22913): Terminated: ok {rc=0} 01:15:56.704871 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22910): Process ended prematurely: osmo-stp_10.42.42.5(pid=22910) [trial-2397↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22910)] [trial-2397↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 01:15:56.713810 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 01:15:56.740317 run osmo-hlr_10.42.42.2(pid=22907): ERR: Terminated: ERROR {rc=237} [trial-2397↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22907)] 01:15:56.787995 run osmo-hlr_10.42.42.2(pid=22907): stdout: | (launched: 2022-12-14_01:15:53.649105) 01:15:56.837231 run osmo-hlr_10.42.42.2(pid=22907): stderr: | [0;m[1;31m20221214011553825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011553825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011553825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011553825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011553825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011553826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011553838 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011553849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011553849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011553849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:15:56.886790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22906): Terminating (SIGTERM) 01:15:56.926194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22909): Terminating (SIGTERM) 01:15:56.965571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22912): Terminating (SIGTERM) 01:15:57.005319 --- ParallelTerminationStrategy: PID 22906 died... 01:15:57.024374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22906): Terminated: ok {rc=0} 01:15:57.068504 --- ParallelTerminationStrategy: PID 22909 died... 01:15:57.086923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22909): Terminated: ok {rc=0} 01:15:57.130576 --- ParallelTerminationStrategy: PID 22912 died... 01:15:57.149251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22912): Terminated: ok {rc=0} 01:15:57.235014 bus /gobi_0: Setting Powered False 01:15:58.334751 bus /gobi_0: Setting Powered False 01:15:59.447293 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 nitb_sms:trx-umtrx --------------------------------------------------------------------- 01:16:00.706996 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:16:00.711180 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 01:16:00.744490 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 01:16:00.753016 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 01:16:00.809811 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 01:16:00.847235 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 01:16:00.854593 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 01:16:01.398634 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 01:16:01.407640 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 01:16:01.423587 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 01:16:01.477391 tst mo_mt_sms.py: using LAC 37529 01:16:01.605255 tst mo_mt_sms.py: using RAC 44 01:16:01.732175 tst mo_mt_sms.py: using CellId 37529 01:16:01.854410 tst mo_mt_sms.py: using BVCI 37530 01:16:02.003010 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 01:16:02.145425 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 01:16:02.276137 tst mo_mt_sms.py:9: start nitb and bts... 01:16:02.497750 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:16:03.157106 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22917): Launched 01:16:03.480494 run osmo-nitb_10.42.42.2(pid=22918): Launched 01:16:03.659971 run osmo-nitb_10.42.42.2(pid=22918): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22918)] 01:16:03.805056 run osmo-nitb_10.42.42.2(pid=22918): stdout: | (launched: 2022-12-14_01:16:03.421328) 01:16:03.951987 run osmo-nitb_10.42.42.2(pid=22918): stderr: | (launched: 2022-12-14_01:16:03.469123) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:16:04.098713 run osmo-nitb_10.42.42.2(pid=22918): stdout: | (launched: 2022-12-14_01:16:03.421328) 01:16:04.239113 run osmo-nitb_10.42.42.2(pid=22918): stderr: | (launched: 2022-12-14_01:16:03.469123) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8b7301f268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22918): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22918) [trial-2397↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22918)] 01:16:04.602631 tst osmo-nitb_10.42.42.2(pid=22918): stdout: | (launched: 2022-12-14_01:16:03.421328) 01:16:04.734007 tst osmo-nitb_10.42.42.2(pid=22918): stderr: | (launched: 2022-12-14_01:16:03.469123) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:16:04.888041 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=22918): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22918) [trial-2397↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22918)] [trial-2397↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 01:16:04.897528 tst mo_mt_sms.py:11: Test FAILED (3.5 sec) 01:16:04.904576 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22917): Terminating (SIGTERM) 01:16:05.115866 --- ParallelTerminationStrategy: PID 22917 died... 01:16:05.137511 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22917): Terminated: ok {rc=0} 01:16:05.226919 bus /sierra_3: Setting Powered False 01:16:06.328238 bus /sierra_3: Setting Powered False 01:16:07.445625 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 sms:trx-umtrx --------------------------------------------------------------------- 01:16:08.647942 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:16:08.652420 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 01:16:08.685760 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 01:16:08.714490 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 01:16:08.767967 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 01:16:08.801339 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 01:16:08.828992 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 01:16:09.375844 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 01:16:09.381846 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:09.392369 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 01:16:09.438774 tst mo_mt_sms.py: using LAC 37530 01:16:09.558875 tst mo_mt_sms.py: using RAC 45 01:16:09.676932 tst mo_mt_sms.py: using CellId 37530 01:16:09.805158 tst mo_mt_sms.py: using BVCI 37531 01:16:09.922368 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:09.933576 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:09.944568 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:09.955849 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:09.966864 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:09.978721 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 01:16:10.101718 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 01:16:10.225600 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:16:10.726103 run create_hlr_db(pid=22922): Launched 01:16:10.850247 bus /sierra_2: Setting Powered False 01:16:11.914247 run create_hlr_db(pid=22922): Terminated: ok {rc=0} 01:16:12.348139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22924): Launched 01:16:12.649987 run osmo-hlr_10.42.42.2(pid=22925): Launched 01:16:12.766525 run osmo-stp_10.42.42.5: Starting osmo-stp 01:16:13.284114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22927): Launched 01:16:13.587157 run osmo-stp_10.42.42.5(pid=22928): Launched 01:16:13.701732 run osmo-msc_10.42.42.6: Starting osmo-msc 01:16:14.246187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22930): Launched 01:16:14.547278 run osmo-msc_10.42.42.6(pid=22931): Launched 01:16:14.716478 run osmo-stp_10.42.42.5(pid=22928): ERR: Terminated: ERROR {rc=1} [trial-2397↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22928)] 01:16:14.842526 run osmo-stp_10.42.42.5(pid=22928): stdout: | (launched: 2022-12-14_01:16:13.529952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:14.969092 run osmo-stp_10.42.42.5(pid=22928): stderr: | [0;m[38;5;43m20221214011613700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011613700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011613701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011613701 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011613702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011613702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011613702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:15.093940 run osmo-stp_10.42.42.5(pid=22928): stdout: | (launched: 2022-12-14_01:16:13.529952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:15.213441 run osmo-stp_10.42.42.5(pid=22928): stderr: | [0;m[38;5;43m20221214011613700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011613700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011613701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011613701 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011613702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011613702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011613702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:15.356684 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=22928): Process ended prematurely: osmo-stp_10.42.42.5(pid=22928) [trial-2397↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22928)] [trial-2397↪sms:trx-umtrx↪mo_mt_sms.py:16] 01:16:15.365144 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 01:16:15.390913 run osmo-hlr_10.42.42.2(pid=22925): ERR: Terminated: ERROR {rc=237} [trial-2397↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22925)] 01:16:15.438048 run osmo-hlr_10.42.42.2(pid=22925): stdout: | (launched: 2022-12-14_01:16:12.594307) 01:16:15.486965 run osmo-hlr_10.42.42.2(pid=22925): stderr: | [0;m[1;31m20221214011612766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011612766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011612766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011612767 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011612767 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011612767 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011612778 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011612787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011612788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011612788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:16:15.555624 run osmo-msc_10.42.42.6(pid=22931): ERR: Terminated: ERROR {rc=2} [trial-2397↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22931)] 01:16:15.602769 run osmo-msc_10.42.42.6(pid=22931): stdout: | (launched: 2022-12-14_01:16:14.491086) 01:16:15.652042 run osmo-msc_10.42.42.6(pid=22931): stderr: | [0;m[38;5;43m20221214011614760 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011614760 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f564c3cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011614760 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011614760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011614761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011614761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011614762 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011614763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011614763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011614763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:16:15.701324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22924): Terminating (SIGTERM) 01:16:15.740671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22927): Terminating (SIGTERM) 01:16:15.779861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22930): Terminating (SIGTERM) 01:16:15.819489 --- ParallelTerminationStrategy: PID 22924 died... 01:16:15.857552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22924): Terminated: ok {rc=0} 01:16:15.927844 --- ParallelTerminationStrategy: PID 22927 died... 01:16:15.948215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22927): Terminated: ok {rc=0} 01:16:15.999861 --- ParallelTerminationStrategy: PID 22930 died... 01:16:16.021242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22930): Terminated: ok {rc=0} 01:16:16.113691 bus /sierra_3: Setting Powered False 01:16:17.210428 bus /sierra_3: Setting Powered False 01:16:18.326781 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 01:16:19.558243 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:16:19.562522 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 01:16:19.595840 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 01:16:19.604165 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 01:16:19.641931 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 01:16:19.675770 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 01:16:19.683216 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 01:16:20.201758 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2397 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 01:16:20.207288 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 01:16:20.218759 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 01:16:20.270801 tst assert_extension.py: using LAC 37531 01:16:20.389675 tst assert_extension.py: using RAC 46 01:16:20.505918 tst assert_extension.py: using CellId 37531 01:16:20.622750 tst assert_extension.py: using BVCI 37532 01:16:20.731637 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 01:16:20.849542 tst assert_extension.py:10: start nitb and bts... 01:16:21.051923 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:16:21.668739 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22936): Launched 01:16:21.986578 run osmo-nitb_10.42.42.2(pid=22937): Launched 01:16:22.167660 run osmo-nitb_10.42.42.2(pid=22937): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22937)] 01:16:22.312232 run osmo-nitb_10.42.42.2(pid=22937): stdout: | (launched: 2022-12-14_01:16:21.926340) 01:16:22.458354 run osmo-nitb_10.42.42.2(pid=22937): stderr: | (launched: 2022-12-14_01:16:21.975096) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:16:22.604550 run osmo-nitb_10.42.42.2(pid=22937): stdout: | (launched: 2022-12-14_01:16:21.926340) 01:16:22.744315 run osmo-nitb_10.42.42.2(pid=22937): stderr: | (launched: 2022-12-14_01:16:21.975096) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8b7301f268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22937): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22937) [trial-2397↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22937)] 01:16:23.110712 tst osmo-nitb_10.42.42.2(pid=22937): stdout: | (launched: 2022-12-14_01:16:21.926340) 01:16:23.241339 tst osmo-nitb_10.42.42.2(pid=22937): stderr: | (launched: 2022-12-14_01:16:21.975096) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:16:23.395041 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=22937): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22937) [trial-2397↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22937)] [trial-2397↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 01:16:23.404216 tst assert_extension.py:12: Test FAILED (3.2 sec) 01:16:23.411507 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22936): Terminating (SIGTERM) 01:16:23.622920 --- ParallelTerminationStrategy: PID 22936 died... 01:16:23.644741 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22936): Terminated: ok {rc=0} 01:16:23.734441 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 ussd:trx-umtrx --------------------------------------------------------------------- 01:16:24.914586 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:16:24.919100 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 01:16:24.952408 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 01:16:24.982159 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 01:16:25.017570 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 01:16:25.049876 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 01:16:25.076591 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 01:16:25.604763 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2397 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 01:16:25.610810 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:25.622000 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 01:16:25.669624 tst assert_extension.py: using LAC 37532 01:16:25.788546 tst assert_extension.py: using RAC 47 01:16:25.911641 tst assert_extension.py: using CellId 37532 01:16:26.028238 tst assert_extension.py: using BVCI 37533 01:16:26.137763 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:26.148557 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:26.159145 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:26.169573 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:26.179978 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:16:26.190474 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 01:16:26.310504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:16:26.811981 run create_hlr_db(pid=22941): Launched 01:16:26.936819 bus /sierra_2: Setting Powered False 01:16:27.999973 run create_hlr_db(pid=22941): Terminated: ok {rc=0} 01:16:28.433667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22943): Launched 01:16:28.738467 run osmo-hlr_10.42.42.2(pid=22944): Launched 01:16:28.853802 run osmo-stp_10.42.42.5: Starting osmo-stp 01:16:29.377621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22946): Launched 01:16:29.679551 run osmo-stp_10.42.42.5(pid=22947): Launched 01:16:29.793969 run osmo-msc_10.42.42.6: Starting osmo-msc 01:16:30.338987 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22949): Launched 01:16:30.639538 run osmo-msc_10.42.42.6(pid=22950): Launched 01:16:30.807332 run osmo-stp_10.42.42.5(pid=22947): ERR: Terminated: ERROR {rc=1} [trial-2397↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22947)] 01:16:31.082997 run osmo-stp_10.42.42.5(pid=22947): stdout: | (launched: 2022-12-14_01:16:29.623710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:31.266835 run osmo-stp_10.42.42.5(pid=22947): stderr: | [0;m[38;5;43m20221214011629794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011629794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011629794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011629795 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011629795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011629795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011629795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:31.395391 run osmo-stp_10.42.42.5(pid=22947): stdout: | (launched: 2022-12-14_01:16:29.623710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:31.518893 run osmo-stp_10.42.42.5(pid=22947): stderr: | [0;m[38;5;43m20221214011629794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011629794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011629794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011629795 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011629795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011629795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011629795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:31.665892 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=22947): Process ended prematurely: osmo-stp_10.42.42.5(pid=22947) [trial-2397↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22947)] [trial-2397↪ussd:trx-umtrx↪assert_extension.py:17] 01:16:31.674970 tst assert_extension.py:17: Test FAILED (6.1 sec) 01:16:31.702019 run osmo-hlr_10.42.42.2(pid=22944): ERR: Terminated: ERROR {rc=237} [trial-2397↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22944)] 01:16:31.752302 run osmo-hlr_10.42.42.2(pid=22944): stdout: | (launched: 2022-12-14_01:16:28.682253) 01:16:31.803489 run osmo-hlr_10.42.42.2(pid=22944): stderr: | [0;m[1;31m20221214011628858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011628858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011628858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011628858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011628858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011628858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011628870 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011628880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011628881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011628881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:16:31.874779 run osmo-msc_10.42.42.6(pid=22950): ERR: Terminated: ERROR {rc=2} [trial-2397↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22950)] 01:16:31.923705 run osmo-msc_10.42.42.6(pid=22950): stdout: | (launched: 2022-12-14_01:16:30.583946) 01:16:31.974221 run osmo-msc_10.42.42.6(pid=22950): stderr: | [0;m[38;5;43m20221214011630880 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011630881 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8aab3d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011630881 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011630881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011630881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011630881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011630886 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011630887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011630887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011630887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:16:32.025463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22943): Terminating (SIGTERM) 01:16:32.067205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22946): Terminating (SIGTERM) 01:16:32.109995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22949): Terminating (SIGTERM) 01:16:32.154749 --- ParallelTerminationStrategy: PID 22943 died... 01:16:32.178294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22943): Terminated: ok {rc=0} 01:16:32.229716 --- ParallelTerminationStrategy: PID 22946 died... 01:16:32.251383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22946): Terminated: ok {rc=0} 01:16:32.300724 --- ParallelTerminationStrategy: PID 22949 died... 01:16:32.321253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22949): Terminated: ok {rc=0} 01:16:32.410614 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 01:16:33.623418 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:16:33.630445 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 01:16:33.662928 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 01:16:33.690942 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 01:16:33.743291 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 01:16:33.775887 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 01:16:33.802732 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 01:16:34.356498 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 01:16:34.411486 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:34.423185 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:16:34.493943 tst mo_mt_call.py: using LAC 37533 01:16:34.622573 tst mo_mt_call.py: using RAC 48 01:16:34.753232 tst mo_mt_call.py: using CellId 37533 01:16:34.875394 tst mo_mt_call.py: using BVCI 37534 01:16:34.986486 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:34.997869 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:35.008907 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:35.020094 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:35.031400 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:35.042704 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:16:35.164186 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:16:35.287173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:16:35.797404 run create_hlr_db(pid=22955): Launched 01:16:35.924166 bus /sierra_2: Setting Powered False 01:16:36.989619 run create_hlr_db(pid=22955): Terminated: ok {rc=0} 01:16:37.429315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22957): Launched 01:16:37.737446 run osmo-hlr_10.42.42.2(pid=22958): Launched 01:16:37.854511 run osmo-stp_10.42.42.5: Starting osmo-stp 01:16:38.389760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22960): Launched 01:16:38.698280 run osmo-stp_10.42.42.5(pid=22961): Launched 01:16:38.815055 run osmo-msc_10.42.42.6: Starting osmo-msc 01:16:39.369634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22963): Launched 01:16:39.678545 run osmo-msc_10.42.42.6(pid=22964): Launched 01:16:39.848935 run osmo-stp_10.42.42.5(pid=22961): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22961)] 01:16:39.977351 run osmo-stp_10.42.42.5(pid=22961): stdout: | (launched: 2022-12-14_01:16:38.641564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:40.106160 run osmo-stp_10.42.42.5(pid=22961): stderr: | [0;m[38;5;43m20221214011638810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011638810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011638811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011638811 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011638812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011638812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011638812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:40.234539 run osmo-stp_10.42.42.5(pid=22961): stdout: | (launched: 2022-12-14_01:16:38.641564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:40.356067 run osmo-stp_10.42.42.5(pid=22961): stderr: | [0;m[38;5;43m20221214011638810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011638810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011638811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011638811 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011638812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011638812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011638812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:40.501751 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22961): Process ended prematurely: osmo-stp_10.42.42.5(pid=22961) [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22961)] [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 01:16:40.510992 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:16:40.537385 run osmo-hlr_10.42.42.2(pid=22958): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22958)] 01:16:40.585112 run osmo-hlr_10.42.42.2(pid=22958): stdout: | (launched: 2022-12-14_01:16:37.680641) 01:16:40.634577 run osmo-hlr_10.42.42.2(pid=22958): stderr: | [0;m[1;31m20221214011637858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011637858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011637858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011637858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011637858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011637858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011637871 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011637882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011637882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011637882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:16:40.703359 run osmo-msc_10.42.42.6(pid=22964): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22964)] 01:16:40.750712 run osmo-msc_10.42.42.6(pid=22964): stdout: | (launched: 2022-12-14_01:16:39.621664) 01:16:40.799716 run osmo-msc_10.42.42.6(pid=22964): stderr: | [0;m[38;5;43m20221214011639892 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011639892 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f44434a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011639892 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011639892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011639892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011639892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011639894 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011639895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011639895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011639895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:16:40.848936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22957): Terminating (SIGTERM) 01:16:40.888746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22960): Terminating (SIGTERM) 01:16:40.928625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22963): Terminating (SIGTERM) 01:16:40.968523 --- ParallelTerminationStrategy: PID 22957 died... 01:16:40.987891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22957): Terminated: ok {rc=0} 01:16:41.031952 --- ParallelTerminationStrategy: PID 22960 died... 01:16:41.050890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22960): Terminated: ok {rc=0} 01:16:41.095013 --- ParallelTerminationStrategy: PID 22963 died... 01:16:41.113961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22963): Terminated: ok {rc=0} 01:16:41.197122 bus /sierra_3: Setting Powered False 01:16:42.295974 bus /sierra_3: Setting Powered False 01:16:43.412697 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 01:16:44.564557 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:44.577021 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:16:44.649437 tst mo_mt_call_osmux.py: using LAC 37534 01:16:44.772731 tst mo_mt_call_osmux.py: using RAC 49 01:16:44.894751 tst mo_mt_call_osmux.py: using CellId 37534 01:16:45.021329 tst mo_mt_call_osmux.py: using BVCI 37535 01:16:45.142970 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:45.154782 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:45.166475 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:45.178175 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:45.190332 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:16:45.202276 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:16:45.319752 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:16:45.441749 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:16:45.953172 run create_hlr_db(pid=22966): Launched 01:16:46.112362 bus /sierra_2: Setting Powered False 01:16:47.175272 run create_hlr_db(pid=22966): Terminated: ok {rc=0} 01:16:47.616103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22968): Launched 01:16:47.922453 run osmo-hlr_10.42.42.2(pid=22969): Launched 01:16:48.041158 run osmo-stp_10.42.42.5: Starting osmo-stp 01:16:48.568223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22971): Launched 01:16:48.875213 run osmo-stp_10.42.42.5(pid=22972): Launched 01:16:48.992376 run osmo-msc_10.42.42.6: Starting osmo-msc 01:16:49.547209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22974): Launched 01:16:49.855335 run osmo-msc_10.42.42.6(pid=22975): Launched 01:16:50.025978 run osmo-stp_10.42.42.5(pid=22972): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22972)] 01:16:50.154558 run osmo-stp_10.42.42.5(pid=22972): stdout: | (launched: 2022-12-14_01:16:48.818457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:50.284167 run osmo-stp_10.42.42.5(pid=22972): stderr: | [0;m[38;5;43m20221214011648986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011648986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011648988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011648988 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011648989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011648989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011648989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:50.411275 run osmo-stp_10.42.42.5(pid=22972): stdout: | (launched: 2022-12-14_01:16:48.818457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:16:50.531804 run osmo-stp_10.42.42.5(pid=22972): stderr: | [0;m[38;5;43m20221214011648986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011648986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011648988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011648988 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011648989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011648989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011648989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:16:50.676235 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22972): Process ended prematurely: osmo-stp_10.42.42.5(pid=22972) [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22972)] [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 01:16:50.685351 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:16:50.711615 run osmo-hlr_10.42.42.2(pid=22969): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22969)] 01:16:50.758796 run osmo-hlr_10.42.42.2(pid=22969): stdout: | (launched: 2022-12-14_01:16:47.866101) 01:16:50.807836 run osmo-hlr_10.42.42.2(pid=22969): stderr: | [0;m[1;31m20221214011648039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011648039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011648039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011648040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011648040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011648040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011648052 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011648060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011648060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011648061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:16:50.876385 run osmo-msc_10.42.42.6(pid=22975): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22975)] 01:16:50.923681 run osmo-msc_10.42.42.6(pid=22975): stdout: | (launched: 2022-12-14_01:16:49.798578) 01:16:50.972548 run osmo-msc_10.42.42.6(pid=22975): stderr: | [0;m[38;5;43m20221214011650069 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011650069 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3dd7684c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011650069 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011650069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011650069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011650069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011650071 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011650071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011650072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011650072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:16:51.021781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22968): Terminating (SIGTERM) 01:16:51.061115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22971): Terminating (SIGTERM) 01:16:51.100426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22974): Terminating (SIGTERM) 01:16:51.140065 --- ParallelTerminationStrategy: PID 22968 died... 01:16:51.159104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22968): Terminated: ok {rc=0} 01:16:51.202588 --- ParallelTerminationStrategy: PID 22971 died... 01:16:51.221122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22971): Terminated: ok {rc=0} 01:16:51.264500 --- ParallelTerminationStrategy: PID 22974 died... 01:16:51.283076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22974): Terminated: ok {rc=0} 01:16:51.368341 bus /sierra_3: Setting Powered False 01:16:52.467824 bus /sierra_3: Setting Powered False 01:16:53.582148 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 01:16:54.828798 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:16:54.835431 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 01:16:54.867449 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 01:16:54.893998 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 01:16:54.945221 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 01:16:54.977402 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 01:16:55.004017 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 01:16:55.556108 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 01:16:55.605181 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:16:55.616365 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:16:55.685382 tst mo_mt_call.py: using LAC 37535 01:16:55.805181 tst mo_mt_call.py: using RAC 50 01:16:55.925472 tst mo_mt_call.py: using CellId 37535 01:16:56.050170 tst mo_mt_call.py: using BVCI 37536 01:16:56.162715 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:16:56.173971 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:16:56.184860 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:16:56.195792 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:16:56.206792 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:16:56.217824 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:16:56.334282 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:16:56.455824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:16:56.965555 run create_hlr_db(pid=22980): Launched 01:16:57.092786 bus /sierra_2: Setting Powered False 01:16:58.157743 run create_hlr_db(pid=22980): Terminated: ok {rc=0} 01:16:58.598147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22982): Launched 01:16:58.906250 run osmo-hlr_10.42.42.2(pid=22983): Launched 01:16:59.023245 run osmo-stp_10.42.42.5: Starting osmo-stp 01:16:59.551258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22985): Launched 01:16:59.859380 run osmo-stp_10.42.42.5(pid=22986): Launched 01:16:59.975753 run osmo-msc_10.42.42.6: Starting osmo-msc 01:17:00.530621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22988): Launched 01:17:00.846408 run osmo-msc_10.42.42.6(pid=22989): Launched 01:17:01.176760 run osmo-stp_10.42.42.5(pid=22986): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22986)] 01:17:01.437774 run osmo-stp_10.42.42.5(pid=22986): stdout: | (launched: 2022-12-14_01:16:59.802515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:01.600440 run osmo-stp_10.42.42.5(pid=22986): stderr: | [0;m[38;5;43m20221214011659972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011659972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011659972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011659973 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011659973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011659973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011659973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:01.744620 run osmo-stp_10.42.42.5(pid=22986): stdout: | (launched: 2022-12-14_01:16:59.802515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:01.879829 run osmo-stp_10.42.42.5(pid=22986): stderr: | [0;m[38;5;43m20221214011659972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011659972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011659972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011659973 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011659973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011659973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011659973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:02.046909 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22986): Process ended prematurely: osmo-stp_10.42.42.5(pid=22986) [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22986)] [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 01:17:02.056939 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 01:17:02.085634 run osmo-hlr_10.42.42.2(pid=22983): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22983)] 01:17:02.139250 run osmo-hlr_10.42.42.2(pid=22983): stdout: | (launched: 2022-12-14_01:16:58.849662) 01:17:02.194274 run osmo-hlr_10.42.42.2(pid=22983): stderr: | [0;m[1;31m20221214011659026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011659026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011659026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011659026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011659026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011659026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011659042 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011659051 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011659052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011659052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:17:02.270186 run osmo-msc_10.42.42.6(pid=22989): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22989)] 01:17:02.322350 run osmo-msc_10.42.42.6(pid=22989): stdout: | (launched: 2022-12-14_01:17:00.781714) 01:17:02.378640 run osmo-msc_10.42.42.6(pid=22989): stderr: | [0;m[38;5;43m20221214011701184 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011701184 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f61dafdcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011701184 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011701184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011701184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011701185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011701187 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011701188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011701188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011701188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:17:02.434877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22982): Terminating (SIGTERM) 01:17:02.477295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22985): Terminating (SIGTERM) 01:17:02.520900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22988): Terminating (SIGTERM) 01:17:02.564527 --- ParallelTerminationStrategy: PID 22982 died... 01:17:02.585790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22982): Terminated: ok {rc=0} 01:17:02.633989 --- ParallelTerminationStrategy: PID 22985 died... 01:17:02.654963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22985): Terminated: ok {rc=0} 01:17:02.703028 --- ParallelTerminationStrategy: PID 22988 died... 01:17:02.723963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22988): Terminated: ok {rc=0} 01:17:02.815236 bus /sierra_3: Setting Powered False 01:17:03.915908 bus /sierra_3: Setting Powered False 01:17:05.035649 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 01:17:06.184035 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:17:06.196287 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:17:06.266532 tst mo_mt_call_osmux.py: using LAC 37536 01:17:06.387816 tst mo_mt_call_osmux.py: using RAC 51 01:17:06.510706 tst mo_mt_call_osmux.py: using CellId 37536 01:17:06.630657 tst mo_mt_call_osmux.py: using BVCI 37537 01:17:06.740882 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:17:06.752211 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:17:06.763297 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:17:06.774273 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:17:06.785318 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:17:06.796338 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:17:06.912254 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:17:07.038831 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:17:07.549717 run create_hlr_db(pid=22994): Launched 01:17:07.677637 bus /sierra_2: Setting Powered False 01:17:08.742334 run create_hlr_db(pid=22994): Terminated: ok {rc=0} 01:17:09.182146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22996): Launched 01:17:09.490659 run osmo-hlr_10.42.42.2(pid=22997): Launched 01:17:09.607200 run osmo-stp_10.42.42.5: Starting osmo-stp 01:17:10.139567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22999): Launched 01:17:10.446615 run osmo-stp_10.42.42.5(pid=23000): Launched 01:17:10.563212 run osmo-msc_10.42.42.6: Starting osmo-msc 01:17:11.116710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23002): Launched 01:17:11.423039 run osmo-msc_10.42.42.6(pid=23003): Launched 01:17:11.594243 run osmo-stp_10.42.42.5(pid=23000): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23000)] 01:17:11.722519 run osmo-stp_10.42.42.5(pid=23000): stdout: | (launched: 2022-12-14_01:17:10.389288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:11.851274 run osmo-stp_10.42.42.5(pid=23000): stderr: | [0;m[38;5;43m20221214011710558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011710558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011710559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011710559 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011710560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011710560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011710560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:11.978810 run osmo-stp_10.42.42.5(pid=23000): stdout: | (launched: 2022-12-14_01:17:10.389288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:12.100050 run osmo-stp_10.42.42.5(pid=23000): stderr: | [0;m[38;5;43m20221214011710558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011710558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011710559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011710559 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011710560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011710560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011710560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:12.244663 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23000): Process ended prematurely: osmo-stp_10.42.42.5(pid=23000) [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23000)] [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 01:17:12.253802 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:17:12.280181 run osmo-hlr_10.42.42.2(pid=22997): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22997)] 01:17:12.327293 run osmo-hlr_10.42.42.2(pid=22997): stdout: | (launched: 2022-12-14_01:17:09.433616) 01:17:12.376560 run osmo-hlr_10.42.42.2(pid=22997): stderr: | [0;m[1;31m20221214011709609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011709609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011709609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011709609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011709609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011709609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011709622 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011709632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011709633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011709633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:17:12.445486 run osmo-msc_10.42.42.6(pid=23003): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23003)] 01:17:12.492695 run osmo-msc_10.42.42.6(pid=23003): stdout: | (launched: 2022-12-14_01:17:11.366486) 01:17:12.541725 run osmo-msc_10.42.42.6(pid=23003): stderr: | [0;m[38;5;43m20221214011711635 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011711635 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc4df496c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011711636 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011711636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011711636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011711636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011711638 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011711638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011711638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011711638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:17:12.590834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22996): Terminating (SIGTERM) 01:17:12.630057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22999): Terminating (SIGTERM) 01:17:12.669450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23002): Terminating (SIGTERM) 01:17:12.709150 --- ParallelTerminationStrategy: PID 22996 died... 01:17:12.728478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22996): Terminated: ok {rc=0} 01:17:12.772121 --- ParallelTerminationStrategy: PID 22999 died... 01:17:12.790878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22999): Terminated: ok {rc=0} 01:17:12.834428 --- ParallelTerminationStrategy: PID 23002 died... 01:17:12.853085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23002): Terminated: ok {rc=0} 01:17:12.939219 bus /sierra_3: Setting Powered False 01:17:14.037071 bus /sierra_3: Setting Powered False 01:17:15.149671 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 01:17:16.403023 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:17:16.410138 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 01:17:16.458506 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 01:17:16.493086 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 01:17:16.561561 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 01:17:16.605962 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 01:17:16.642939 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 01:17:17.192351 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 01:17:17.252364 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:17.264715 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:17:17.336754 tst mo_mt_call.py: using LAC 37537 01:17:17.467363 tst mo_mt_call.py: using RAC 52 01:17:17.596877 tst mo_mt_call.py: using CellId 37537 01:17:17.726521 tst mo_mt_call.py: using BVCI 37538 01:17:17.846813 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:17.858637 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:17.870383 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:17.882081 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:17.894676 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:17.907128 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:17:18.027014 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:17:18.146455 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:17:18.622414 run create_hlr_db(pid=23008): Launched 01:17:18.749257 bus /sierra_2: Setting Powered False 01:17:19.810570 run create_hlr_db(pid=23008): Terminated: ok {rc=0} 01:17:20.238852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23010): Launched 01:17:20.547329 run osmo-hlr_10.42.42.2(pid=23011): Launched 01:17:20.663286 run osmo-stp_10.42.42.5: Starting osmo-stp 01:17:21.191741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23013): Launched 01:17:21.500291 run osmo-stp_10.42.42.5(pid=23014): Launched 01:17:21.617131 run osmo-msc_10.42.42.6: Starting osmo-msc 01:17:22.172046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23016): Launched 01:17:22.479577 run osmo-msc_10.42.42.6(pid=23017): Launched 01:17:22.651527 run osmo-stp_10.42.42.5(pid=23014): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23014)] 01:17:22.780935 run osmo-stp_10.42.42.5(pid=23014): stdout: | (launched: 2022-12-14_01:17:21.443570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:22.910333 run osmo-stp_10.42.42.5(pid=23014): stderr: | [0;m[38;5;43m20221214011721615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011721615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011721616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011721616 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011721617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011721617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011721617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:23.038152 run osmo-stp_10.42.42.5(pid=23014): stdout: | (launched: 2022-12-14_01:17:21.443570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:23.159529 run osmo-stp_10.42.42.5(pid=23014): stderr: | [0;m[38;5;43m20221214011721615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011721615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011721616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011721616 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011721617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011721617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011721617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:23.304657 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23014): Process ended prematurely: osmo-stp_10.42.42.5(pid=23014) [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23014)] [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 01:17:23.313847 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:17:23.340209 run osmo-hlr_10.42.42.2(pid=23011): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23011)] 01:17:23.387549 run osmo-hlr_10.42.42.2(pid=23011): stdout: | (launched: 2022-12-14_01:17:20.489916) 01:17:23.436305 run osmo-hlr_10.42.42.2(pid=23011): stderr: | [0;m[1;31m20221214011720665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011720665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011720665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011720665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011720665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011720665 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011720677 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011720685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011720685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011720685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:17:23.504515 run osmo-msc_10.42.42.6(pid=23017): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23017)] 01:17:23.551786 run osmo-msc_10.42.42.6(pid=23017): stdout: | (launched: 2022-12-14_01:17:22.422708) 01:17:23.600649 run osmo-msc_10.42.42.6(pid=23017): stderr: | [0;m[38;5;43m20221214011722694 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011722694 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fec3d4d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011722694 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011722694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011722694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011722694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011722696 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011722696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011722696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011722697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:17:23.649700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23010): Terminating (SIGTERM) 01:17:23.688790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23013): Terminating (SIGTERM) 01:17:23.727883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23016): Terminating (SIGTERM) 01:17:23.767141 --- ParallelTerminationStrategy: PID 23010 died... 01:17:23.786416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23010): Terminated: ok {rc=0} 01:17:23.830179 --- ParallelTerminationStrategy: PID 23013 died... 01:17:23.848838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23013): Terminated: ok {rc=0} 01:17:23.892095 --- ParallelTerminationStrategy: PID 23016 died... 01:17:23.910851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23016): Terminated: ok {rc=0} 01:17:23.996562 bus /sierra_3: Setting Powered False 01:17:25.097680 bus /sierra_3: Setting Powered False 01:17:26.213336 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 01:17:27.363385 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:27.375970 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:17:27.448564 tst mo_mt_call_osmux.py: using LAC 37538 01:17:27.577392 tst mo_mt_call_osmux.py: using RAC 53 01:17:27.707509 tst mo_mt_call_osmux.py: using CellId 37538 01:17:27.835990 tst mo_mt_call_osmux.py: using BVCI 37539 01:17:27.955423 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:27.967082 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:27.978650 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:27.990172 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:28.002553 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:17:28.014488 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:17:28.131745 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:17:28.253766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:17:28.765216 run create_hlr_db(pid=23019): Launched 01:17:28.890229 bus /sierra_2: Setting Powered False 01:17:29.955234 run create_hlr_db(pid=23019): Terminated: ok {rc=0} 01:17:30.414957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23021): Launched 01:17:30.746887 run osmo-hlr_10.42.42.2(pid=23022): Launched 01:17:30.874850 run osmo-stp_10.42.42.5: Starting osmo-stp 01:17:31.569752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23024): Launched 01:17:31.910940 run osmo-stp_10.42.42.5(pid=23025): Launched 01:17:32.214703 run osmo-msc_10.42.42.6: Starting osmo-msc 01:17:32.908536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23027): Launched 01:17:33.240621 run osmo-msc_10.42.42.6(pid=23028): Launched 01:17:33.423115 run osmo-stp_10.42.42.5(pid=23025): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23025)] 01:17:33.560044 run osmo-stp_10.42.42.5(pid=23025): stdout: | (launched: 2022-12-14_01:17:31.846395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:33.699104 run osmo-stp_10.42.42.5(pid=23025): stderr: | [0;m[38;5;43m20221214011732188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011732188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011732188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011732189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011732189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011732189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011732189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:33.836176 run osmo-stp_10.42.42.5(pid=23025): stdout: | (launched: 2022-12-14_01:17:31.846395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:33.967063 run osmo-stp_10.42.42.5(pid=23025): stderr: | [0;m[38;5;43m20221214011732188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011732188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011732188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011732189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011732189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011732189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011732189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:34.123966 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23025): Process ended prematurely: osmo-stp_10.42.42.5(pid=23025) [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23025)] [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 01:17:34.133982 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 01:17:34.161882 run osmo-hlr_10.42.42.2(pid=23022): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23022)] 01:17:34.213118 run osmo-hlr_10.42.42.2(pid=23022): stdout: | (launched: 2022-12-14_01:17:30.686576) 01:17:34.265226 run osmo-hlr_10.42.42.2(pid=23022): stderr: | [0;m[1;31m20221214011730961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011730961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011730961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011730961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011730961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011730961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011730973 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011730992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011730992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011730992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:17:34.338187 run osmo-msc_10.42.42.6(pid=23028): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23028)] 01:17:34.388246 run osmo-msc_10.42.42.6(pid=23028): stdout: | (launched: 2022-12-14_01:17:33.179694) 01:17:34.440437 run osmo-msc_10.42.42.6(pid=23028): stderr: | [0;m[38;5;43m20221214011733503 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011733503 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2975765c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011733503 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011733503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011733503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011733504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011733505 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011733506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011733506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011733506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:17:34.493122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23021): Terminating (SIGTERM) 01:17:34.535039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23024): Terminating (SIGTERM) 01:17:34.577448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23027): Terminating (SIGTERM) 01:17:34.620678 --- ParallelTerminationStrategy: PID 23021 died... 01:17:34.641281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23021): Terminated: ok {rc=0} 01:17:34.688015 --- ParallelTerminationStrategy: PID 23024 died... 01:17:34.708089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23024): Terminated: ok {rc=0} 01:17:34.754540 --- ParallelTerminationStrategy: PID 23027 died... 01:17:34.774561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23027): Terminated: ok {rc=0} 01:17:34.863361 bus /sierra_3: Setting Powered False 01:17:35.962142 bus /sierra_3: Setting Powered False 01:17:37.077968 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 01:17:38.333418 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:17:38.340590 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 01:17:38.375306 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 01:17:38.403808 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 01:17:38.458316 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 01:17:38.491453 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 01:17:38.519547 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 01:17:39.069172 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 01:17:39.119286 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:39.130650 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:17:39.198830 tst mo_mt_call.py: using LAC 37539 01:17:39.321124 tst mo_mt_call.py: using RAC 54 01:17:39.441302 tst mo_mt_call.py: using CellId 37539 01:17:39.562498 tst mo_mt_call.py: using BVCI 37540 01:17:39.674864 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:39.686001 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:39.697057 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:39.707906 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:39.718874 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:39.729788 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:17:39.849855 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:17:39.972372 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:17:40.449491 run create_hlr_db(pid=23034): Launched 01:17:40.574833 bus /sierra_2: Setting Powered False 01:17:41.635936 run create_hlr_db(pid=23034): Terminated: ok {rc=0} 01:17:42.085650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23036): Launched 01:17:42.416182 run osmo-hlr_10.42.42.2(pid=23037): Launched 01:17:42.542179 run osmo-stp_10.42.42.5: Starting osmo-stp 01:17:43.109730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23039): Launched 01:17:43.442293 run osmo-stp_10.42.42.5(pid=23040): Launched 01:17:43.569396 run osmo-msc_10.42.42.6: Starting osmo-msc 01:17:44.165459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23042): Launched 01:17:44.499368 run osmo-msc_10.42.42.6(pid=23043): Launched 01:17:44.683985 run osmo-stp_10.42.42.5(pid=23040): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23040)] 01:17:44.822616 run osmo-stp_10.42.42.5(pid=23040): stdout: | (launched: 2022-12-14_01:17:43.381736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:44.963569 run osmo-stp_10.42.42.5(pid=23040): stderr: | [0;m[38;5;43m20221214011743573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011743574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011743574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011743574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011743575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011743575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011743575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:45.101695 run osmo-stp_10.42.42.5(pid=23040): stdout: | (launched: 2022-12-14_01:17:43.381736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:45.233078 run osmo-stp_10.42.42.5(pid=23040): stderr: | [0;m[38;5;43m20221214011743573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011743574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011743574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011743574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011743575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011743575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011743575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:45.390292 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23040): Process ended prematurely: osmo-stp_10.42.42.5(pid=23040) [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23040)] [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 01:17:45.399960 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:17:45.428375 run osmo-hlr_10.42.42.2(pid=23037): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23037)] 01:17:45.480009 run osmo-hlr_10.42.42.2(pid=23037): stdout: | (launched: 2022-12-14_01:17:42.355802) 01:17:45.532482 run osmo-hlr_10.42.42.2(pid=23037): stderr: | [0;m[1;31m20221214011742551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011742551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011742551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011742551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011742551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011742551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011742563 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011742572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011742572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011742572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:17:45.605405 run osmo-msc_10.42.42.6(pid=23043): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23043)] 01:17:45.655804 run osmo-msc_10.42.42.6(pid=23043): stdout: | (launched: 2022-12-14_01:17:44.438412) 01:17:45.708509 run osmo-msc_10.42.42.6(pid=23043): stderr: | [0;m[38;5;43m20221214011744760 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011744760 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8338864c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011744760 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011744761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011744761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011744761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011744763 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011744763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011744763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011744763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:17:45.761419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23036): Terminating (SIGTERM) 01:17:45.803267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23039): Terminating (SIGTERM) 01:17:45.846610 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23042): Terminating (SIGTERM) 01:17:45.893673 --- ParallelTerminationStrategy: PID 23036 died... 01:17:45.921672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23036): Terminated: ok {rc=0} 01:17:45.970063 --- ParallelTerminationStrategy: PID 23039 died... 01:17:45.991196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23039): Terminated: ok {rc=0} 01:17:46.039715 --- ParallelTerminationStrategy: PID 23042 died... 01:17:46.068938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23042): Terminated: ok {rc=0} 01:17:46.163452 bus /sierra_3: Setting Powered False 01:17:47.270548 bus /sierra_3: Setting Powered False 01:17:48.386973 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 01:17:49.538498 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:49.550922 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:17:49.623631 tst mo_mt_call_osmux.py: using LAC 37540 01:17:49.753388 tst mo_mt_call_osmux.py: using RAC 55 01:17:49.880774 tst mo_mt_call_osmux.py: using CellId 37540 01:17:50.009585 tst mo_mt_call_osmux.py: using BVCI 37541 01:17:50.121088 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:50.132478 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:50.143743 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:50.154942 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:50.166229 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:17:50.177212 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:17:50.293619 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:17:50.414378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:17:50.923129 run create_hlr_db(pid=23045): Launched 01:17:51.049058 bus /sierra_2: Setting Powered False 01:17:52.113664 run create_hlr_db(pid=23045): Terminated: ok {rc=0} 01:17:52.552306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23047): Launched 01:17:52.860445 run osmo-hlr_10.42.42.2(pid=23048): Launched 01:17:52.975791 run osmo-stp_10.42.42.5: Starting osmo-stp 01:17:53.501879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23050): Launched 01:17:53.808816 run osmo-stp_10.42.42.5(pid=23051): Launched 01:17:53.927127 run osmo-msc_10.42.42.6: Starting osmo-msc 01:17:54.480300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23053): Launched 01:17:54.787080 run osmo-msc_10.42.42.6(pid=23054): Launched 01:17:54.960292 run osmo-stp_10.42.42.5(pid=23051): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23051)] 01:17:55.089551 run osmo-stp_10.42.42.5(pid=23051): stdout: | (launched: 2022-12-14_01:17:53.751391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:55.222280 run osmo-stp_10.42.42.5(pid=23051): stderr: | [0;m[38;5;43m20221214011753920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011753920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011753921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011753921 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011753922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011753922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011753922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:55.348853 run osmo-stp_10.42.42.5(pid=23051): stdout: | (launched: 2022-12-14_01:17:53.751391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:17:55.469725 run osmo-stp_10.42.42.5(pid=23051): stderr: | [0;m[38;5;43m20221214011753920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011753920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011753921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011753921 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011753922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011753922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011753922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:17:55.614687 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23051): Process ended prematurely: osmo-stp_10.42.42.5(pid=23051) [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23051)] [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 01:17:55.623795 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:17:55.650166 run osmo-hlr_10.42.42.2(pid=23048): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23048)] 01:17:55.697284 run osmo-hlr_10.42.42.2(pid=23048): stdout: | (launched: 2022-12-14_01:17:52.803837) 01:17:55.746019 run osmo-hlr_10.42.42.2(pid=23048): stderr: | [0;m[1;31m20221214011752979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011752979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011752979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011752979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011752979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011752979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011752991 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011753000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011753001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011753001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:17:55.814053 run osmo-msc_10.42.42.6(pid=23054): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23054)] 01:17:55.861217 run osmo-msc_10.42.42.6(pid=23054): stdout: | (launched: 2022-12-14_01:17:54.729571) 01:17:55.909727 run osmo-msc_10.42.42.6(pid=23054): stderr: | [0;m[38;5;43m20221214011755000 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011755002 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4617d83c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011755002 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011755002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011755002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011755002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011755004 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011755004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011755005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011755005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:17:55.958555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23047): Terminating (SIGTERM) 01:17:55.997552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23050): Terminating (SIGTERM) 01:17:56.036640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23053): Terminating (SIGTERM) 01:17:56.075944 --- ParallelTerminationStrategy: PID 23047 died... 01:17:56.095059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23047): Terminated: ok {rc=0} 01:17:56.138515 --- ParallelTerminationStrategy: PID 23050 died... 01:17:56.157068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23050): Terminated: ok {rc=0} 01:17:56.200053 --- ParallelTerminationStrategy: PID 23053 died... 01:17:56.218587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23053): Terminated: ok {rc=0} 01:17:56.303355 bus /sierra_3: Setting Powered False 01:17:57.401927 bus /sierra_3: Setting Powered False 01:17:58.515384 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:17:59.763101 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:17:59.769660 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:17:59.802068 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:17:59.828908 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:17:59.882359 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:17:59.917183 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:17:59.945699 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:18:00.489884 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:18:00.547469 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:00.559243 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:18:00.631806 tst mo_mt_call.py: using LAC 37541 01:18:00.766410 tst mo_mt_call.py: using RAC 56 01:18:00.918807 tst mo_mt_call.py: using CellId 37541 01:18:01.060192 tst mo_mt_call.py: using BVCI 37542 01:18:01.182430 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:01.195104 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:01.207566 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:01.220519 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:01.233836 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:01.247105 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:18:01.376723 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:18:01.510513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:18:02.098367 run create_hlr_db(pid=23059): Launched 01:18:02.265144 bus /sierra_2: Setting Powered False 01:18:03.328931 run create_hlr_db(pid=23059): Terminated: ok {rc=0} 01:18:03.782628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23061): Launched 01:18:04.110119 run osmo-hlr_10.42.42.2(pid=23062): Launched 01:18:04.234161 run osmo-stp_10.42.42.5: Starting osmo-stp 01:18:04.798349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23064): Launched 01:18:05.127275 run osmo-stp_10.42.42.5(pid=23065): Launched 01:18:05.251586 run osmo-msc_10.42.42.6: Starting osmo-msc 01:18:05.842939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23067): Launched 01:18:06.170287 run osmo-msc_10.42.42.6(pid=23068): Launched 01:18:06.351307 run osmo-stp_10.42.42.5(pid=23065): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23065)] 01:18:06.488074 run osmo-stp_10.42.42.5(pid=23065): stdout: | (launched: 2022-12-14_01:18:05.067544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:06.625952 run osmo-stp_10.42.42.5(pid=23065): stderr: | [0;m[38;5;43m20221214011805256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011805256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011805257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011805257 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011805258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011805258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011805258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:06.761565 run osmo-stp_10.42.42.5(pid=23065): stdout: | (launched: 2022-12-14_01:18:05.067544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:06.890849 run osmo-stp_10.42.42.5(pid=23065): stderr: | [0;m[38;5;43m20221214011805256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011805256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011805257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011805257 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011805258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011805258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011805258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:07.046175 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23065): Process ended prematurely: osmo-stp_10.42.42.5(pid=23065) [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23065)] [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:18:07.055851 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 01:18:07.083786 run osmo-hlr_10.42.42.2(pid=23062): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23062)] 01:18:07.134145 run osmo-hlr_10.42.42.2(pid=23062): stdout: | (launched: 2022-12-14_01:18:04.049787) 01:18:07.185756 run osmo-hlr_10.42.42.2(pid=23062): stderr: | [0;m[1;31m20221214011804245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011804245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011804245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011804245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011804245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011804246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011804257 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011804266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011804266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011804266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:18:07.257764 run osmo-msc_10.42.42.6(pid=23068): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23068)] 01:18:07.307480 run osmo-msc_10.42.42.6(pid=23068): stdout: | (launched: 2022-12-14_01:18:06.110093) 01:18:07.359118 run osmo-msc_10.42.42.6(pid=23068): stderr: | [0;m[38;5;43m20221214011806429 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011806430 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f672ab85c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011806430 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011806430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011806430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011806430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011806432 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011806432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011806432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011806432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:18:07.410857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23061): Terminating (SIGTERM) 01:18:07.452459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23064): Terminating (SIGTERM) 01:18:07.494059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23067): Terminating (SIGTERM) 01:18:07.535869 --- ParallelTerminationStrategy: PID 23061 died... 01:18:07.556226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23061): Terminated: ok {rc=0} 01:18:07.602725 --- ParallelTerminationStrategy: PID 23064 died... 01:18:07.622491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23064): Terminated: ok {rc=0} 01:18:07.668705 --- ParallelTerminationStrategy: PID 23067 died... 01:18:07.688491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23067): Terminated: ok {rc=0} 01:18:07.776614 bus /sierra_3: Setting Powered False 01:18:08.875180 bus /sierra_3: Setting Powered False 01:18:09.991395 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:18:11.141050 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:11.153269 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:18:11.225840 tst mo_mt_call_osmux.py: using LAC 37542 01:18:11.353678 tst mo_mt_call_osmux.py: using RAC 57 01:18:11.473413 tst mo_mt_call_osmux.py: using CellId 37542 01:18:11.592455 tst mo_mt_call_osmux.py: using BVCI 37543 01:18:11.702521 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:11.713648 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:11.724522 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:11.735440 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:11.746411 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:18:11.757315 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:18:11.877411 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:18:11.994963 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:18:12.499551 run create_hlr_db(pid=23070): Launched 01:18:12.624210 bus /sierra_2: Setting Powered False 01:18:13.688125 run create_hlr_db(pid=23070): Terminated: ok {rc=0} 01:18:14.122843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23072): Launched 01:18:14.422574 run osmo-hlr_10.42.42.2(pid=23073): Launched 01:18:14.536736 run osmo-stp_10.42.42.5: Starting osmo-stp 01:18:15.063911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23075): Launched 01:18:15.362805 run osmo-stp_10.42.42.5(pid=23076): Launched 01:18:15.475593 run osmo-msc_10.42.42.6: Starting osmo-msc 01:18:16.069795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23078): Launched 01:18:16.389735 run osmo-msc_10.42.42.6(pid=23079): Launched 01:18:16.713021 run osmo-stp_10.42.42.5(pid=23076): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23076)] 01:18:16.965139 run osmo-stp_10.42.42.5(pid=23076): stdout: | (launched: 2022-12-14_01:18:15.307614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:17.199502 run osmo-stp_10.42.42.5(pid=23076): stderr: | [0;m[38;5;43m20221214011815474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011815474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011815475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011815475 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011815476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011815476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011815476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:17.350371 run osmo-stp_10.42.42.5(pid=23076): stdout: | (launched: 2022-12-14_01:18:15.307614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:17.478624 run osmo-stp_10.42.42.5(pid=23076): stderr: | [0;m[38;5;43m20221214011815474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011815474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011815475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011815475 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011815476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011815476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011815476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:17.631844 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23076): Process ended prematurely: osmo-stp_10.42.42.5(pid=23076) [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23076)] [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:18:17.641502 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 01:18:17.669340 run osmo-hlr_10.42.42.2(pid=23073): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23073)] 01:18:17.719859 run osmo-hlr_10.42.42.2(pid=23073): stdout: | (launched: 2022-12-14_01:18:14.367184) 01:18:17.772310 run osmo-hlr_10.42.42.2(pid=23073): stderr: | [0;m[1;31m20221214011814539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011814539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011814539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011814539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011814539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011814539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011814551 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011814559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011814559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011814559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:18:17.844626 run osmo-msc_10.42.42.6(pid=23079): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23079)] 01:18:17.894116 run osmo-msc_10.42.42.6(pid=23079): stdout: | (launched: 2022-12-14_01:18:16.319750) 01:18:17.945572 run osmo-msc_10.42.42.6(pid=23079): stderr: | [0;m[38;5;43m20221214011816891 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011816891 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f26dcd87c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011816891 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011816891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011816891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011816891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011816897 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011816898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011816898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011816898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:18:17.997416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23072): Terminating (SIGTERM) 01:18:18.039605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23075): Terminating (SIGTERM) 01:18:18.081980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23078): Terminating (SIGTERM) 01:18:18.124549 --- ParallelTerminationStrategy: PID 23072 died... 01:18:18.144933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23072): Terminated: ok {rc=0} 01:18:18.191226 --- ParallelTerminationStrategy: PID 23075 died... 01:18:18.211079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23075): Terminated: ok {rc=0} 01:18:18.256903 --- ParallelTerminationStrategy: PID 23078 died... 01:18:18.276703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23078): Terminated: ok {rc=0} 01:18:18.364424 bus /sierra_3: Setting Powered False 01:18:19.462316 bus /sierra_3: Setting Powered False 01:18:20.580056 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:18:21.831928 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:18:21.838449 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:18:21.870317 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:18:21.896872 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:18:21.949197 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:18:21.982121 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:18:22.009463 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:18:22.557943 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:18:22.605871 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:22.616994 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:18:22.685055 tst mo_mt_call.py: using LAC 37543 01:18:22.803490 tst mo_mt_call.py: using RAC 58 01:18:22.922709 tst mo_mt_call.py: using CellId 37543 01:18:23.049530 tst mo_mt_call.py: using BVCI 37544 01:18:23.167321 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:23.179009 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:23.190574 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:23.202131 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:23.214099 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:23.225923 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:18:23.340405 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:18:23.452290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:18:23.910860 run create_hlr_db(pid=23084): Launched 01:18:24.032763 bus /sierra_2: Setting Powered False 01:18:25.091379 run create_hlr_db(pid=23084): Terminated: ok {rc=0} 01:18:25.524749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23086): Launched 01:18:25.843587 run osmo-hlr_10.42.42.2(pid=23087): Launched 01:18:25.964405 run osmo-stp_10.42.42.5: Starting osmo-stp 01:18:26.512479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23089): Launched 01:18:26.830231 run osmo-stp_10.42.42.5(pid=23090): Launched 01:18:26.950610 run osmo-msc_10.42.42.6: Starting osmo-msc 01:18:27.524139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23092): Launched 01:18:27.842521 run osmo-msc_10.42.42.6(pid=23093): Launched 01:18:28.019289 run osmo-stp_10.42.42.5(pid=23090): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23090)] 01:18:28.154443 run osmo-stp_10.42.42.5(pid=23090): stdout: | (launched: 2022-12-14_01:18:26.772156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:28.289393 run osmo-stp_10.42.42.5(pid=23090): stderr: | [0;m[38;5;43m20221214011826958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011826958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011826958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011826959 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011826959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011826959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011826959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:28.422670 run osmo-stp_10.42.42.5(pid=23090): stdout: | (launched: 2022-12-14_01:18:26.772156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:28.548893 run osmo-stp_10.42.42.5(pid=23090): stderr: | [0;m[38;5;43m20221214011826958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011826958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011826958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011826959 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011826959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011826959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011826959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:28.700233 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23090): Process ended prematurely: osmo-stp_10.42.42.5(pid=23090) [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23090)] [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:18:28.710032 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:18:28.737622 run osmo-hlr_10.42.42.2(pid=23087): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23087)] 01:18:28.787438 run osmo-hlr_10.42.42.2(pid=23087): stdout: | (launched: 2022-12-14_01:18:25.785360) 01:18:28.838593 run osmo-hlr_10.42.42.2(pid=23087): stderr: | [0;m[1;31m20221214011825976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011825976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011825976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011825976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011825976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011825976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011825989 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011825997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011825998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011825998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:18:28.910468 run osmo-msc_10.42.42.6(pid=23093): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23093)] 01:18:28.959350 run osmo-msc_10.42.42.6(pid=23093): stdout: | (launched: 2022-12-14_01:18:27.784175) 01:18:29.010340 run osmo-msc_10.42.42.6(pid=23093): stderr: | [0;m[38;5;43m20221214011828098 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011828098 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb11a05bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011828098 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011828098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011828098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011828099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011828100 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011828101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011828101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011828101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:18:29.062359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23086): Terminating (SIGTERM) 01:18:29.103881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23089): Terminating (SIGTERM) 01:18:29.145969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23092): Terminating (SIGTERM) 01:18:29.187683 --- ParallelTerminationStrategy: PID 23086 died... 01:18:29.208002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23086): Terminated: ok {rc=0} 01:18:29.254371 --- ParallelTerminationStrategy: PID 23089 died... 01:18:29.274046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23089): Terminated: ok {rc=0} 01:18:29.319568 --- ParallelTerminationStrategy: PID 23092 died... 01:18:29.339383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23092): Terminated: ok {rc=0} 01:18:29.425704 bus /sierra_3: Setting Powered False 01:18:30.523599 bus /sierra_3: Setting Powered False 01:18:31.637643 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:18:32.780764 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:32.792412 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:18:32.860784 tst mo_mt_call_osmux.py: using LAC 37544 01:18:32.976752 tst mo_mt_call_osmux.py: using RAC 59 01:18:33.093066 tst mo_mt_call_osmux.py: using CellId 37544 01:18:33.208169 tst mo_mt_call_osmux.py: using BVCI 37545 01:18:33.314820 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:33.326004 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:33.336844 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:33.347767 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:33.358694 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:18:33.369632 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:18:33.488904 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:18:33.604901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:18:34.063453 run create_hlr_db(pid=23095): Launched 01:18:34.184603 bus /sierra_2: Setting Powered False 01:18:35.243758 run create_hlr_db(pid=23095): Terminated: ok {rc=0} 01:18:35.656575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23097): Launched 01:18:35.952648 run osmo-hlr_10.42.42.2(pid=23098): Launched 01:18:36.063799 run osmo-stp_10.42.42.5: Starting osmo-stp 01:18:36.574435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23100): Launched 01:18:36.870511 run osmo-stp_10.42.42.5(pid=23101): Launched 01:18:36.982060 run osmo-msc_10.42.42.6: Starting osmo-msc 01:18:37.515970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23103): Launched 01:18:37.812087 run osmo-msc_10.42.42.6(pid=23104): Launched 01:18:37.975884 run osmo-stp_10.42.42.5(pid=23101): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23101)] 01:18:38.102056 run osmo-stp_10.42.42.5(pid=23101): stdout: | (launched: 2022-12-14_01:18:36.815694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:38.226725 run osmo-stp_10.42.42.5(pid=23101): stderr: | [0;m[38;5;43m20221214011836980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011836981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011836981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011836981 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011836982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011836982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011836982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:38.350680 run osmo-stp_10.42.42.5(pid=23101): stdout: | (launched: 2022-12-14_01:18:36.815694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:38.467430 run osmo-stp_10.42.42.5(pid=23101): stderr: | [0;m[38;5;43m20221214011836980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011836981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011836981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011836981 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011836982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011836982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011836982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:38.607829 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23101): Process ended prematurely: osmo-stp_10.42.42.5(pid=23101) [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23101)] [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:18:38.616645 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 01:18:38.642525 run osmo-hlr_10.42.42.2(pid=23098): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23098)] 01:18:38.689495 run osmo-hlr_10.42.42.2(pid=23098): stdout: | (launched: 2022-12-14_01:18:35.897963) 01:18:38.737742 run osmo-hlr_10.42.42.2(pid=23098): stderr: | [0;m[1;31m20221214011836071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011836071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011836071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011836071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011836071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011836071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011836089 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011836098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011836098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011836098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:18:38.805585 run osmo-msc_10.42.42.6(pid=23104): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23104)] 01:18:38.852169 run osmo-msc_10.42.42.6(pid=23104): stdout: | (launched: 2022-12-14_01:18:37.756535) 01:18:38.900445 run osmo-msc_10.42.42.6(pid=23104): stderr: | [0;m[38;5;43m20221214011838020 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011838021 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc8dd743c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011838021 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011838021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011838021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011838021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011838023 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011838023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011838023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011838024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:18:38.948899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23097): Terminating (SIGTERM) 01:18:38.987779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23100): Terminating (SIGTERM) 01:18:39.026575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23103): Terminating (SIGTERM) 01:18:39.065776 --- ParallelTerminationStrategy: PID 23097 died... 01:18:39.084535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23097): Terminated: ok {rc=0} 01:18:39.127964 --- ParallelTerminationStrategy: PID 23100 died... 01:18:39.146377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23100): Terminated: ok {rc=0} 01:18:39.189248 --- ParallelTerminationStrategy: PID 23103 died... 01:18:39.207357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23103): Terminated: ok {rc=0} 01:18:39.291673 bus /sierra_3: Setting Powered False 01:18:40.390454 bus /sierra_3: Setting Powered False 01:18:41.501519 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:18:42.749489 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:18:42.755480 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:18:42.788076 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 01:18:42.815696 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 01:18:42.867869 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:18:42.900667 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 01:18:42.928174 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 01:18:43.474654 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 01:18:43.526207 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:43.537131 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:18:43.605301 tst mo_mt_call.py: using LAC 37545 01:18:43.721122 tst mo_mt_call.py: using RAC 60 01:18:43.837260 tst mo_mt_call.py: using CellId 37545 01:18:43.952570 tst mo_mt_call.py: using BVCI 37546 01:18:44.058527 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:44.069291 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:44.079786 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:44.090392 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:44.100901 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:44.111932 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:18:44.230538 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:18:44.347860 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:18:44.839311 run create_hlr_db(pid=23111): Launched 01:18:44.962122 bus /sierra_2: Setting Powered False 01:18:46.026804 run create_hlr_db(pid=23111): Terminated: ok {rc=0} 01:18:46.475135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23113): Launched 01:18:46.797599 run osmo-hlr_10.42.42.2(pid=23114): Launched 01:18:47.047015 run osmo-stp_10.42.42.5: Starting osmo-stp 01:18:47.637350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23116): Launched 01:18:47.958471 run osmo-stp_10.42.42.5(pid=23117): Launched 01:18:48.080611 run osmo-msc_10.42.42.6: Starting osmo-msc 01:18:48.659109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23119): Launched 01:18:48.979592 run osmo-msc_10.42.42.6(pid=23120): Launched 01:18:49.159429 run osmo-stp_10.42.42.5(pid=23117): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23117)] 01:18:49.294567 run osmo-stp_10.42.42.5(pid=23117): stdout: | (launched: 2022-12-14_01:18:47.899436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:49.430501 run osmo-stp_10.42.42.5(pid=23117): stderr: | [0;m[38;5;43m20221214011848088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011848088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011848088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011848088 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011848089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011848089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011848089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:49.564043 run osmo-stp_10.42.42.5(pid=23117): stdout: | (launched: 2022-12-14_01:18:47.899436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:49.691444 run osmo-stp_10.42.42.5(pid=23117): stderr: | [0;m[38;5;43m20221214011848088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011848088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011848088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011848088 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011848089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011848089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011848089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:49.844040 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23117): Process ended prematurely: osmo-stp_10.42.42.5(pid=23117) [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23117)] [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 01:18:49.853820 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 01:18:49.881244 run osmo-hlr_10.42.42.2(pid=23114): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23114)] 01:18:49.931170 run osmo-hlr_10.42.42.2(pid=23114): stdout: | (launched: 2022-12-14_01:18:46.738617) 01:18:49.982626 run osmo-hlr_10.42.42.2(pid=23114): stderr: | [0;m[1;31m20221214011846979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011846979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011846979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011846979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011846979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011846979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011846994 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011847015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011847015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011847016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:18:50.054376 run osmo-msc_10.42.42.6(pid=23120): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23120)] 01:18:50.103788 run osmo-msc_10.42.42.6(pid=23120): stdout: | (launched: 2022-12-14_01:18:48.920603) 01:18:50.155042 run osmo-msc_10.42.42.6(pid=23120): stderr: | [0;m[38;5;43m20221214011849238 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011849238 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8603ad1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011849238 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011849238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011849238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011849239 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011849240 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011849241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011849241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011849241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:18:50.206210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23113): Terminating (SIGTERM) 01:18:50.248054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23116): Terminating (SIGTERM) 01:18:50.290061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23119): Terminating (SIGTERM) 01:18:50.332060 --- ParallelTerminationStrategy: PID 23113 died... 01:18:50.352372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23113): Terminated: ok {rc=0} 01:18:50.398598 --- ParallelTerminationStrategy: PID 23116 died... 01:18:50.418477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23116): Terminated: ok {rc=0} 01:18:50.464517 --- ParallelTerminationStrategy: PID 23119 died... 01:18:50.484393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23119): Terminated: ok {rc=0} 01:18:50.572166 bus /sierra_3: Setting Powered False 01:18:51.670178 bus /sierra_3: Setting Powered False 01:18:52.785383 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 01:18:53.933533 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:53.945544 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:18:54.017358 tst mo_mt_call_osmux.py: using LAC 37546 01:18:54.144447 tst mo_mt_call_osmux.py: using RAC 61 01:18:54.269723 tst mo_mt_call_osmux.py: using CellId 37546 01:18:54.394701 tst mo_mt_call_osmux.py: using BVCI 37547 01:18:54.511161 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:54.522564 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:54.533683 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:54.544679 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:54.556078 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:18:54.567579 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:18:54.682752 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:18:54.802788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:18:55.299615 run create_hlr_db(pid=23122): Launched 01:18:55.423182 bus /sierra_2: Setting Powered False 01:18:56.486509 run create_hlr_db(pid=23122): Terminated: ok {rc=0} 01:18:56.914188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23124): Launched 01:18:57.212913 run osmo-hlr_10.42.42.2(pid=23125): Launched 01:18:57.326896 run osmo-stp_10.42.42.5: Starting osmo-stp 01:18:57.839809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23127): Launched 01:18:58.137989 run osmo-stp_10.42.42.5(pid=23128): Launched 01:18:58.250392 run osmo-msc_10.42.42.6: Starting osmo-msc 01:18:58.795465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23130): Launched 01:18:59.095036 run osmo-msc_10.42.42.6(pid=23131): Launched 01:18:59.261494 run osmo-stp_10.42.42.5(pid=23128): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23128)] 01:18:59.387865 run osmo-stp_10.42.42.5(pid=23128): stdout: | (launched: 2022-12-14_01:18:58.082681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:59.513744 run osmo-stp_10.42.42.5(pid=23128): stderr: | [0;m[38;5;43m20221214011858250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011858250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011858250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011858251 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011858251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011858251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011858251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:59.637886 run osmo-stp_10.42.42.5(pid=23128): stdout: | (launched: 2022-12-14_01:18:58.082681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:18:59.756381 run osmo-stp_10.42.42.5(pid=23128): stderr: | [0;m[38;5;43m20221214011858250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011858250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011858250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011858251 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011858251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011858251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011858251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:18:59.898535 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23128): Process ended prematurely: osmo-stp_10.42.42.5(pid=23128) [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23128)] [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 01:18:59.907456 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 01:18:59.933883 run osmo-hlr_10.42.42.2(pid=23125): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23125)] 01:18:59.981211 run osmo-hlr_10.42.42.2(pid=23125): stdout: | (launched: 2022-12-14_01:18:57.157852) 01:19:00.030279 run osmo-hlr_10.42.42.2(pid=23125): stderr: | [0;m[1;31m20221214011857330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011857330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011857330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011857330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011857330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011857330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011857342 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011857351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011857351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011857351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:19:00.098765 run osmo-msc_10.42.42.6(pid=23131): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23131)] 01:19:00.146007 run osmo-msc_10.42.42.6(pid=23131): stdout: | (launched: 2022-12-14_01:18:59.039414) 01:19:00.194815 run osmo-msc_10.42.42.6(pid=23131): stderr: | [0;m[38;5;43m20221214011859307 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011859307 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe74c263c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011859307 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011859307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011859307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011859307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011859309 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011859310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011859310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011859310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:19:00.244089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23124): Terminating (SIGTERM) 01:19:00.283599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23127): Terminating (SIGTERM) 01:19:00.323151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23130): Terminating (SIGTERM) 01:19:00.362969 --- ParallelTerminationStrategy: PID 23124 died... 01:19:00.382167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23124): Terminated: ok {rc=0} 01:19:00.425869 --- ParallelTerminationStrategy: PID 23127 died... 01:19:00.444553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23127): Terminated: ok {rc=0} 01:19:00.488121 --- ParallelTerminationStrategy: PID 23130 died... 01:19:00.506793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23130): Terminated: ok {rc=0} 01:19:00.592274 bus /sierra_3: Setting Powered False 01:19:01.693332 bus /sierra_3: Setting Powered False 01:19:02.813766 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 01:19:04.060556 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:19:04.068687 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 01:19:04.102942 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 01:19:04.130357 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 01:19:04.182836 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 01:19:04.216578 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 01:19:04.244113 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 01:19:04.793415 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 01:19:04.840881 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:04.852215 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:19:04.907899 tst mo_mt_call.py: using LAC 37547 01:19:05.024207 tst mo_mt_call.py: using RAC 62 01:19:05.141081 tst mo_mt_call.py: using CellId 37547 01:19:05.256116 tst mo_mt_call.py: using BVCI 37548 01:19:05.364724 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:05.375955 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:05.386951 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:05.397924 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:05.409060 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:05.420087 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:19:05.538909 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:19:05.654284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:19:06.115960 run create_hlr_db(pid=23136): Launched 01:19:06.237849 bus /sierra_2: Setting Powered False 01:19:07.297921 run create_hlr_db(pid=23136): Terminated: ok {rc=0} 01:19:07.734754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23138): Launched 01:19:08.038359 run osmo-hlr_10.42.42.2(pid=23139): Launched 01:19:08.150691 run osmo-stp_10.42.42.5: Starting osmo-stp 01:19:08.667319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23141): Launched 01:19:08.965574 run osmo-stp_10.42.42.5(pid=23142): Launched 01:19:09.078742 run osmo-msc_10.42.42.6: Starting osmo-msc 01:19:09.621586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23144): Launched 01:19:09.921756 run osmo-msc_10.42.42.6(pid=23145): Launched 01:19:10.087627 run osmo-stp_10.42.42.5(pid=23142): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23142)] 01:19:10.213229 run osmo-stp_10.42.42.5(pid=23142): stdout: | (launched: 2022-12-14_01:19:08.910456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:10.339087 run osmo-stp_10.42.42.5(pid=23142): stderr: | [0;m[38;5;43m20221214011909078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011909078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011909078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011909079 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011909079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011909079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011909079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:10.463209 run osmo-stp_10.42.42.5(pid=23142): stdout: | (launched: 2022-12-14_01:19:08.910456) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:10.581331 run osmo-stp_10.42.42.5(pid=23142): stderr: | [0;m[38;5;43m20221214011909078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011909078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011909078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011909079 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011909079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011909079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011909079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:10.723371 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23142): Process ended prematurely: osmo-stp_10.42.42.5(pid=23142) [trial-2397↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23142)] [trial-2397↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 01:19:10.732216 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 01:19:10.758423 run osmo-hlr_10.42.42.2(pid=23139): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23139)] 01:19:10.805615 run osmo-hlr_10.42.42.2(pid=23139): stdout: | (launched: 2022-12-14_01:19:07.983249) 01:19:10.854930 run osmo-hlr_10.42.42.2(pid=23139): stderr: | [0;m[1;31m20221214011908154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011908155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011908155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011908155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011908155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011908155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011908167 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011908176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011908176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011908176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:19:10.923444 run osmo-msc_10.42.42.6(pid=23145): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23145)] 01:19:10.970547 run osmo-msc_10.42.42.6(pid=23145): stdout: | (launched: 2022-12-14_01:19:09.866410) 01:19:11.019077 run osmo-msc_10.42.42.6(pid=23145): stderr: | [0;m[38;5;43m20221214011910133 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011910134 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f149ec90c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011910134 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011910134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011910134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011910134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011910136 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011910136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011910136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011910136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:19:11.067994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23138): Terminating (SIGTERM) 01:19:11.107364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23141): Terminating (SIGTERM) 01:19:11.146743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23144): Terminating (SIGTERM) 01:19:11.186392 --- ParallelTerminationStrategy: PID 23138 died... 01:19:11.205453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23138): Terminated: ok {rc=0} 01:19:11.249268 --- ParallelTerminationStrategy: PID 23141 died... 01:19:11.267775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23141): Terminated: ok {rc=0} 01:19:11.311260 --- ParallelTerminationStrategy: PID 23144 died... 01:19:11.329733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23144): Terminated: ok {rc=0} 01:19:11.415823 bus /sierra_3: Setting Powered False 01:19:12.515057 bus /sierra_3: Setting Powered False 01:19:13.629589 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 01:19:14.773833 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:14.785642 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:19:14.837444 tst mo_mt_call_osmux.py: using LAC 37548 01:19:14.964310 tst mo_mt_call_osmux.py: using RAC 63 01:19:15.090737 tst mo_mt_call_osmux.py: using CellId 37548 01:19:15.218883 tst mo_mt_call_osmux.py: using BVCI 37549 01:19:15.335464 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:15.347345 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:15.358926 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:15.370527 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:15.382531 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:19:15.394350 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:19:15.510863 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:19:15.625953 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:19:16.142260 run create_hlr_db(pid=23147): Launched 01:19:16.303233 bus /sierra_2: Setting Powered False 01:19:17.363102 run create_hlr_db(pid=23147): Terminated: ok {rc=0} 01:19:17.803376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23149): Launched 01:19:18.126021 run osmo-hlr_10.42.42.2(pid=23150): Launched 01:19:18.247598 run osmo-stp_10.42.42.5: Starting osmo-stp 01:19:18.801404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23152): Launched 01:19:19.124768 run osmo-stp_10.42.42.5(pid=23153): Launched 01:19:19.246327 run osmo-msc_10.42.42.6: Starting osmo-msc 01:19:19.825316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23155): Launched 01:19:20.147607 run osmo-msc_10.42.42.6(pid=23156): Launched 01:19:20.325285 run osmo-stp_10.42.42.5(pid=23153): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23153)] 01:19:20.460162 run osmo-stp_10.42.42.5(pid=23153): stdout: | (launched: 2022-12-14_01:19:19.065517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:20.595419 run osmo-stp_10.42.42.5(pid=23153): stderr: | [0;m[38;5;43m20221214011919254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011919254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011919255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011919255 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011919256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011919256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011919256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:20.729740 run osmo-stp_10.42.42.5(pid=23153): stdout: | (launched: 2022-12-14_01:19:19.065517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:20.857398 run osmo-stp_10.42.42.5(pid=23153): stderr: | [0;m[38;5;43m20221214011919254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011919254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011919255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011919255 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011919256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011919256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011919256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:21.010515 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23153): Process ended prematurely: osmo-stp_10.42.42.5(pid=23153) [trial-2397↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23153)] [trial-2397↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 01:19:21.020437 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:19:21.048146 run osmo-hlr_10.42.42.2(pid=23150): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23150)] 01:19:21.098884 run osmo-hlr_10.42.42.2(pid=23150): stdout: | (launched: 2022-12-14_01:19:18.066944) 01:19:21.150732 run osmo-hlr_10.42.42.2(pid=23150): stderr: | [0;m[1;31m20221214011918260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011918260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011918260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011918260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011918260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011918260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011918276 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011918286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011918286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011918286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:19:21.222401 run osmo-msc_10.42.42.6(pid=23156): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23156)] 01:19:21.271410 run osmo-msc_10.42.42.6(pid=23156): stdout: | (launched: 2022-12-14_01:19:20.088515) 01:19:21.322650 run osmo-msc_10.42.42.6(pid=23156): stderr: | [0;m[38;5;43m20221214011920404 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011920405 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4212e14c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011920405 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011920405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011920405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011920405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011920407 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011920407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011920407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011920407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:19:21.375093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23149): Terminating (SIGTERM) 01:19:21.416276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23152): Terminating (SIGTERM) 01:19:21.458014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23155): Terminating (SIGTERM) 01:19:21.500210 --- ParallelTerminationStrategy: PID 23149 died... 01:19:21.520523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23149): Terminated: ok {rc=0} 01:19:21.566333 --- ParallelTerminationStrategy: PID 23152 died... 01:19:21.586041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23152): Terminated: ok {rc=0} 01:19:21.631650 --- ParallelTerminationStrategy: PID 23155 died... 01:19:21.651402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23155): Terminated: ok {rc=0} 01:19:21.738667 bus /sierra_3: Setting Powered False 01:19:22.836498 bus /sierra_3: Setting Powered False 01:19:23.954693 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 emergency:trx-umtrx --------------------------------------------------------------------- 01:19:25.210684 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:19:25.216694 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 01:19:25.250809 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 01:19:25.278858 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 01:19:25.363287 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 01:19:25.396066 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 01:19:25.423472 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 01:19:26.008927 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2397 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 01:19:26.014215 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:26.025420 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 01:19:26.074946 tst emergency_mo_mt_call.py: using LAC 37549 01:19:26.196709 tst emergency_mo_mt_call.py: using RAC 64 01:19:26.318546 tst emergency_mo_mt_call.py: using CellId 37549 01:19:26.440846 tst emergency_mo_mt_call.py: using BVCI 37550 01:19:26.555369 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:26.566485 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:26.577354 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:26.588209 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:26.599439 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:26.610268 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:26.726298 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:26.841844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:19:27.296766 run create_hlr_db(pid=23162): Launched 01:19:27.418695 bus /sierra_2: Setting Powered False 01:19:28.478142 run create_hlr_db(pid=23162): Terminated: ok {rc=0} 01:19:28.889468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23164): Launched 01:19:29.184812 run osmo-hlr_10.42.42.2(pid=23165): Launched 01:19:29.295503 run osmo-stp_10.42.42.5: Starting osmo-stp 01:19:29.799769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23167): Launched 01:19:30.094214 run osmo-stp_10.42.42.5(pid=23168): Launched 01:19:30.215290 tst emergency_mo_mt_call.py: using MSISDN 8428 01:19:30.364332 run osmo-msc_10.42.42.6: Starting osmo-msc 01:19:30.925778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23170): Launched 01:19:31.249736 run osmo-msc_10.42.42.6(pid=23171): Launched 01:19:31.581104 run osmo-stp_10.42.42.5(pid=23168): ERR: Terminated: ERROR {rc=1} [trial-2397↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23168)] 01:19:31.742997 run osmo-stp_10.42.42.5(pid=23168): stdout: | (launched: 2022-12-14_01:19:30.039472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:31.986078 run osmo-stp_10.42.42.5(pid=23168): stderr: | [0;m[38;5;43m20221214011930205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011930205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011930205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011930206 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011930206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011930206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011930206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:32.222477 run osmo-stp_10.42.42.5(pid=23168): stdout: | (launched: 2022-12-14_01:19:30.039472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:32.341461 run osmo-stp_10.42.42.5(pid=23168): stderr: | [0;m[38;5;43m20221214011930205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011930205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011930205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011930206 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011930206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011930206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011930206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:32.483759 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=23168): Process ended prematurely: osmo-stp_10.42.42.5(pid=23168) [trial-2397↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23168)] [trial-2397↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 01:19:32.492160 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 01:19:32.518149 run osmo-hlr_10.42.42.2(pid=23165): ERR: Terminated: ERROR {rc=237} [trial-2397↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23165)] 01:19:32.566102 run osmo-hlr_10.42.42.2(pid=23165): stdout: | (launched: 2022-12-14_01:19:29.130005) 01:19:32.615477 run osmo-hlr_10.42.42.2(pid=23165): stderr: | [0;m[1;31m20221214011929303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011929303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011929303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011929303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011929303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011929303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011929315 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011929324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011929324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011929324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:19:32.684245 run osmo-msc_10.42.42.6(pid=23171): ERR: Terminated: ERROR {rc=2} [trial-2397↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23171)] 01:19:32.731608 run osmo-msc_10.42.42.6(pid=23171): stdout: | (launched: 2022-12-14_01:19:31.183551) 01:19:32.780653 run osmo-msc_10.42.42.6(pid=23171): stderr: | [0;m[38;5;43m20221214011931796 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011931796 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f112d4acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011931796 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011931796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011931796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011931796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011931803 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011931803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011931803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011931803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:19:32.830004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23164): Terminating (SIGTERM) 01:19:32.869167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23167): Terminating (SIGTERM) 01:19:32.908373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23170): Terminating (SIGTERM) 01:19:32.947679 --- ParallelTerminationStrategy: PID 23164 died... 01:19:32.966715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23164): Terminated: ok {rc=0} 01:19:33.010088 --- ParallelTerminationStrategy: PID 23167 died... 01:19:33.028543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23167): Terminated: ok {rc=0} 01:19:33.071558 --- ParallelTerminationStrategy: PID 23170 died... 01:19:33.090011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23170): Terminated: ok {rc=0} 01:19:33.174917 bus /sierra_3: Setting Powered False 01:19:34.272829 bus /sierra_3: Setting Powered False 01:19:35.387137 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 01:19:36.473079 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:36.484412 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 01:19:36.533697 tst emergency_preemptive_call.py: using LAC 37550 01:19:36.649632 tst emergency_preemptive_call.py: using RAC 65 01:19:36.765747 tst emergency_preemptive_call.py: using CellId 37550 01:19:36.881009 tst emergency_preemptive_call.py: using BVCI 37551 01:19:36.987022 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:36.997726 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:37.008242 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:37.018675 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:37.029083 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 01:19:37.039776 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:37.154168 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:37.271184 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:37.385948 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:37.499505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:19:37.958968 run create_hlr_db(pid=23173): Launched 01:19:38.079708 bus /sierra_2: Setting Powered False 01:19:39.138950 run create_hlr_db(pid=23173): Terminated: ok {rc=0} 01:19:39.574744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23175): Launched 01:19:39.893701 run osmo-hlr_10.42.42.2(pid=23176): Launched 01:19:40.015553 run osmo-stp_10.42.42.5: Starting osmo-stp 01:19:40.565742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23178): Launched 01:19:40.883259 run osmo-stp_10.42.42.5(pid=23179): Launched 01:19:41.013428 tst emergency_preemptive_call.py: using MSISDN 8429 01:19:41.176729 run osmo-msc_10.42.42.6: Starting osmo-msc 01:19:41.745356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23181): Launched 01:19:42.061525 run osmo-msc_10.42.42.6(pid=23182): Launched 01:19:42.238279 run osmo-stp_10.42.42.5(pid=23179): ERR: Terminated: ERROR {rc=1} [trial-2397↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23179)] 01:19:42.373199 run osmo-stp_10.42.42.5(pid=23179): stdout: | (launched: 2022-12-14_01:19:40.825064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:42.507870 run osmo-stp_10.42.42.5(pid=23179): stderr: | [0;m[38;5;43m20221214011941010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011941010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011941010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011941011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011941011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011941011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011941012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:42.641432 run osmo-stp_10.42.42.5(pid=23179): stdout: | (launched: 2022-12-14_01:19:40.825064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:19:42.768334 run osmo-stp_10.42.42.5(pid=23179): stderr: | [0;m[38;5;43m20221214011941010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011941010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011941010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011941011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011941011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011941011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011941012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:19:42.920387 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=23179): Process ended prematurely: osmo-stp_10.42.42.5(pid=23179) [trial-2397↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23179)] [trial-2397↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 01:19:42.929787 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 01:19:42.957326 run osmo-hlr_10.42.42.2(pid=23176): ERR: Terminated: ERROR {rc=237} [trial-2397↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23176)] 01:19:43.007814 run osmo-hlr_10.42.42.2(pid=23176): stdout: | (launched: 2022-12-14_01:19:39.835344) 01:19:43.059614 run osmo-hlr_10.42.42.2(pid=23176): stderr: | [0;m[1;31m20221214011940027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011940027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011940027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011940027 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011940028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011940028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011940040 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011940048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011940049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011940049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:19:43.132403 run osmo-msc_10.42.42.6(pid=23182): ERR: Terminated: ERROR {rc=2} [trial-2397↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23182)] 01:19:43.182033 run osmo-msc_10.42.42.6(pid=23182): stdout: | (launched: 2022-12-14_01:19:42.003232) 01:19:43.233778 run osmo-msc_10.42.42.6(pid=23182): stderr: | [0;m[38;5;43m20221214011942319 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214011942319 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb0accb4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214011942319 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214011942319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214011942319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214011942320 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214011942321 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214011942322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214011942322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214011942322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:19:43.286145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23175): Terminating (SIGTERM) 01:19:43.327637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23178): Terminating (SIGTERM) 01:19:43.369793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23181): Terminating (SIGTERM) 01:19:43.412348 --- ParallelTerminationStrategy: PID 23175 died... 01:19:43.432701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23175): Terminated: ok {rc=0} 01:19:43.479332 --- ParallelTerminationStrategy: PID 23178 died... 01:19:43.499200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23178): Terminated: ok {rc=0} 01:19:43.545501 --- ParallelTerminationStrategy: PID 23181 died... 01:19:43.565431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23181): Terminated: ok {rc=0} 01:19:43.652756 bus /sierra_9: Setting Powered False 01:19:44.750642 bus /sierra_9: Setting Powered False 01:19:45.865708 bus /sierra_8: Setting Powered False 01:19:46.972601 bus /sierra_8: Setting Powered False 01:19:48.091139 bus /sierra_3: Setting Powered False 01:19:49.189451 bus /sierra_3: Setting Powered False 01:19:50.308479 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-umtrx --------------------------------------------------------------------- 01:19:51.581361 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:19:51.585506 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 01:19:51.617197 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 01:19:51.654767 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 01:19:51.740123 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 01:19:51.771862 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 01:19:51.809890 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 01:19:52.398788 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 01:19:52.447661 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:52.458209 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 01:19:52.508126 tst cs_paging_gprs_active.py: using LAC 37551 01:19:52.623531 tst cs_paging_gprs_active.py: using RAC 66 01:19:52.741650 tst cs_paging_gprs_active.py: using CellId 37551 01:19:52.858782 tst cs_paging_gprs_active.py: using BVCI 37552 01:19:52.969270 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:52.979769 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:52.990130 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:53.000386 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:53.010648 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:53.020798 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:53.031274 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:53.041447 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:19:53.052124 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:53.171072 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:19:53.285517 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:19:53.488642 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:19:53.792075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23188): Launched 01:19:54.055576 run iperf3-srv_10.42.42.10(pid=23189): Launched 01:19:54.167967 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:19:54.369246 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:19:54.671141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23190): Launched 01:19:54.933049 run iperf3-srv_10.42.42.10(pid=23191): Launched 01:19:55.045407 tst cs_paging_gprs_active.py:38: start network... 01:19:55.245973 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:19:55.713318 run create_hlr_db(pid=23192): Launched 01:19:55.837867 bus /sierra_2: Setting Powered False 01:19:56.897604 run create_hlr_db(pid=23192): Terminated: ok {rc=0} 01:19:57.339942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23194): Launched 01:19:57.663621 run osmo-hlr_10.42.42.2(pid=23195): Launched 01:19:57.787301 run osmo-stp_10.42.42.5: Starting osmo-stp 01:19:58.346457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23197): Launched 01:19:58.670883 run osmo-stp_10.42.42.5(pid=23198): Launched 01:19:58.794680 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:19:59.350579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23200): Launched 01:19:59.473775 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:19:59.745663 run patchelf(pid=23201): Launched 01:19:59.926652 run osmo-stp_10.42.42.5(pid=23198): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23198)] 01:20:00.064051 run osmo-stp_10.42.42.5(pid=23198): stdout: | (launched: 2022-12-14_01:19:58.611019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:00.203702 run osmo-stp_10.42.42.5(pid=23198): stderr: | [0;m[38;5;43m20221214011958796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011958797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011958797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011958797 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011958798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011958798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011958798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:00.343641 run osmo-stp_10.42.42.5(pid=23198): stdout: | (launched: 2022-12-14_01:19:58.611019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:00.476616 run osmo-stp_10.42.42.5(pid=23198): stderr: | [0;m[38;5;43m20221214011958796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214011958797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214011958797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214011958797 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214011958798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214011958798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214011958798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:00.634374 run patchelf(pid=23201): Terminating (SIGINT) 01:20:00.816511 run patchelf(pid=23201): Terminated: ok {rc=0} 01:20:00.964231 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23198): Process ended prematurely: osmo-stp_10.42.42.5(pid=23198) [trial-2397↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23198)] [trial-2397↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 01:20:00.974503 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 01:20:01.011903 run osmo-hlr_10.42.42.2(pid=23195): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23195)] 01:20:01.062491 run osmo-hlr_10.42.42.2(pid=23195): stdout: | (launched: 2022-12-14_01:19:57.603868) 01:20:01.114484 run osmo-hlr_10.42.42.2(pid=23195): stderr: | [0;m[1;31m20221214011957796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214011957796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214011957796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214011957796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214011957796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214011957796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214011957809 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214011957819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214011957819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214011957819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:20:01.166008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23188): Terminating (SIGTERM) 01:20:01.207863 run iperf3-srv_10.42.42.10(pid=23189): Terminating (SIGTERM) 01:20:01.253216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23190): Terminating (SIGTERM) 01:20:01.294854 run iperf3-srv_10.42.42.10(pid=23191): Terminating (SIGTERM) 01:20:01.353814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23194): Terminating (SIGTERM) 01:20:01.396432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23197): Terminating (SIGTERM) 01:20:01.440388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23200): Terminating (SIGTERM) 01:20:01.484344 --- ParallelTerminationStrategy: PID 23188 died... 01:20:01.504089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23188): Terminated: ok {rc=0} 01:20:01.551550 --- ParallelTerminationStrategy: PID 23189 died... 01:20:01.571316 run iperf3-srv_10.42.42.10(pid=23189): Terminated {rc=256} 01:20:01.617992 --- ParallelTerminationStrategy: PID 23190 died... 01:20:01.637318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23190): Terminated: ok {rc=0} 01:20:01.682781 --- ParallelTerminationStrategy: PID 23191 died... 01:20:01.702507 run iperf3-srv_10.42.42.10(pid=23191): Terminated {rc=256} 01:20:01.747111 --- ParallelTerminationStrategy: PID 23194 died... 01:20:01.766507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23194): Terminated: ok {rc=0} 01:20:01.813056 --- ParallelTerminationStrategy: PID 23197 died... 01:20:01.833571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23197): Terminated: ok {rc=0} 01:20:01.878514 --- ParallelTerminationStrategy: PID 23200 died... 01:20:01.898382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23200): Terminated: ok {rc=0} 01:20:01.983772 bus /gobi_0: Setting Powered False 01:20:03.081329 bus /gobi_0: Setting Powered False 01:20:04.196142 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-umtrx iperf3.py ---------------------------------------------- 01:20:05.341511 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:05.352690 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 01:20:05.402861 tst iperf3.py: using LAC 37552 01:20:05.520682 tst iperf3.py: using RAC 67 01:20:05.638330 tst iperf3.py: using CellId 37552 01:20:05.756041 tst iperf3.py: using BVCI 37553 01:20:05.867335 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:05.877970 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:05.888333 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:05.898688 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:05.908799 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:05.919022 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:05.929471 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:05.939687 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:05.950115 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:20:06.063312 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:20:06.265268 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:06.566916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23205): Launched 01:20:06.829144 run iperf3-srv_10.42.42.10(pid=23206): Launched 01:20:06.941425 tst iperf3.py:8: start network... 01:20:07.141711 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:20:07.604463 run create_hlr_db(pid=23207): Launched 01:20:07.727630 bus /gobi_6: Setting Powered False 01:20:08.788273 run create_hlr_db(pid=23207): Terminated: ok {rc=0} 01:20:09.228107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23209): Launched 01:20:09.550817 run osmo-hlr_10.42.42.2(pid=23210): Launched 01:20:09.673631 run osmo-stp_10.42.42.5: Starting osmo-stp 01:20:10.227897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23212): Launched 01:20:10.549958 run osmo-stp_10.42.42.5(pid=23213): Launched 01:20:10.672557 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:20:11.227673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23215): Launched 01:20:11.353300 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:20:11.625955 run patchelf(pid=23216): Launched 01:20:11.805699 run osmo-stp_10.42.42.5(pid=23213): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23213)] 01:20:11.943302 run osmo-stp_10.42.42.5(pid=23213): stdout: | (launched: 2022-12-14_01:20:10.490655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:12.083451 run osmo-stp_10.42.42.5(pid=23213): stderr: | [0;m[38;5;43m20221214012010679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012010679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012010679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012010679 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012010680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012010680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012010680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:12.222772 run osmo-stp_10.42.42.5(pid=23213): stdout: | (launched: 2022-12-14_01:20:10.490655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:12.354897 run osmo-stp_10.42.42.5(pid=23213): stderr: | [0;m[38;5;43m20221214012010679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012010679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012010679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012010679 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012010680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012010680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012010680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:12.511932 run patchelf(pid=23216): Terminating (SIGINT) 01:20:12.691831 run patchelf(pid=23216): Terminated: ok {rc=0} 01:20:12.822498 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23213): Process ended prematurely: osmo-stp_10.42.42.5(pid=23213) [trial-2397↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23213)] [trial-2397↪gprs:trx-umtrx↪iperf3.py:8] 01:20:12.832473 tst iperf3.py:8: Test FAILED (7.5 sec) 01:20:12.860861 run osmo-hlr_10.42.42.2(pid=23210): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23210)] 01:20:12.911356 run osmo-hlr_10.42.42.2(pid=23210): stdout: | (launched: 2022-12-14_01:20:09.491589) 01:20:12.963037 run osmo-hlr_10.42.42.2(pid=23210): stderr: | [0;m[1;31m20221214012009685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012009685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012009685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012009685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012009685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012009685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012009701 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012009709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012009709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012009709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:20:13.015267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23205): Terminating (SIGTERM) 01:20:13.057328 run iperf3-srv_10.42.42.10(pid=23206): Terminating (SIGTERM) 01:20:13.099535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23209): Terminating (SIGTERM) 01:20:13.141790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23212): Terminating (SIGTERM) 01:20:13.183783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23215): Terminating (SIGTERM) 01:20:13.226406 --- ParallelTerminationStrategy: PID 23205 died... 01:20:13.246913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23205): Terminated: ok {rc=0} 01:20:13.293595 --- ParallelTerminationStrategy: PID 23206 died... 01:20:13.313579 run iperf3-srv_10.42.42.10(pid=23206): Terminated {rc=256} 01:20:13.359664 --- ParallelTerminationStrategy: PID 23209 died... 01:20:13.379530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23209): Terminated: ok {rc=0} 01:20:13.425637 --- ParallelTerminationStrategy: PID 23212 died... 01:20:13.445451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23212): Terminated: ok {rc=0} 01:20:13.491602 --- ParallelTerminationStrategy: PID 23215 died... 01:20:13.511353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23215): Terminated: ok {rc=0} 01:20:13.600119 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 01:20:14.752286 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:14.763832 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 01:20:14.811707 tst iperf3m4.py: using LAC 37553 01:20:14.929768 tst iperf3m4.py: using RAC 68 01:20:15.045861 tst iperf3m4.py: using CellId 37553 01:20:15.162240 tst iperf3m4.py: using BVCI 37554 01:20:15.272175 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:15.283058 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:15.293764 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:15.304302 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:15.314953 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:15.325316 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:15.336454 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:15.347177 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:15.358065 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:20:15.477580 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:20:15.602788 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:20:15.719068 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:20:15.845538 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:20:16.081386 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:16.419561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23217): Launched 01:20:16.723341 run iperf3-srv_10.42.42.10(pid=23218): Launched 01:20:16.862917 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:20:17.089774 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:17.417996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23219): Launched 01:20:17.699888 run iperf3-srv_10.42.42.10(pid=23220): Launched 01:20:17.821526 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:20:18.039198 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:18.363194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23221): Launched 01:20:18.643431 run iperf3-srv_10.42.42.10(pid=23222): Launched 01:20:18.764169 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:20:18.980926 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:19.305432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23223): Launched 01:20:19.586738 run iperf3-srv_10.42.42.10(pid=23224): Launched 01:20:19.707220 tst iperf3m4.py:8: start network... 01:20:19.923171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:20:20.423347 run create_hlr_db(pid=23225): Launched 01:20:20.546444 bus /gobi_6: Setting Powered False 01:20:21.610167 run create_hlr_db(pid=23225): Terminated: ok {rc=0} 01:20:22.059823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23227): Launched 01:20:22.382713 run osmo-hlr_10.42.42.2(pid=23228): Launched 01:20:22.505361 run osmo-stp_10.42.42.5: Starting osmo-stp 01:20:23.063880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23230): Launched 01:20:23.388473 run osmo-stp_10.42.42.5(pid=23231): Launched 01:20:23.510820 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:20:24.066591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23233): Launched 01:20:24.186643 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:20:24.441296 run patchelf(pid=23234): Launched 01:20:24.610413 run osmo-stp_10.42.42.5(pid=23231): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23231)] 01:20:24.738761 run osmo-stp_10.42.42.5(pid=23231): stdout: | (launched: 2022-12-14_01:20:23.329061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:24.869250 run osmo-stp_10.42.42.5(pid=23231): stderr: | [0;m[38;5;43m20221214012023516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012023516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012023517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012023517 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012023518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012023518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012023518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:25.000059 run osmo-stp_10.42.42.5(pid=23231): stdout: | (launched: 2022-12-14_01:20:23.329061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:25.124186 run osmo-stp_10.42.42.5(pid=23231): stderr: | [0;m[38;5;43m20221214012023516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012023516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012023517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012023517 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012023518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012023518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012023518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:25.271109 run patchelf(pid=23234): Terminating (SIGINT) 01:20:25.440296 run patchelf(pid=23234): Terminated: ok {rc=0} 01:20:25.562898 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23231): Process ended prematurely: osmo-stp_10.42.42.5(pid=23231) [trial-2397↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23231)] [trial-2397↪gprs:trx-umtrx↪iperf3m4.py:8] 01:20:25.572327 tst iperf3m4.py:8: Test FAILED (10.9 sec) 01:20:25.599359 run osmo-hlr_10.42.42.2(pid=23228): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23228)] 01:20:25.646930 run osmo-hlr_10.42.42.2(pid=23228): stdout: | (launched: 2022-12-14_01:20:22.323439) 01:20:25.695669 run osmo-hlr_10.42.42.2(pid=23228): stderr: | [0;m[1;31m20221214012022516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012022516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012022516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012022516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012022516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012022516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012022528 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012022537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012022537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012022537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:20:25.745025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23217): Terminating (SIGTERM) 01:20:25.784227 run iperf3-srv_10.42.42.10(pid=23218): Terminating (SIGTERM) 01:20:25.823422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23219): Terminating (SIGTERM) 01:20:25.862955 run iperf3-srv_10.42.42.10(pid=23220): Terminating (SIGTERM) 01:20:25.902206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23221): Terminating (SIGTERM) 01:20:25.941576 run iperf3-srv_10.42.42.10(pid=23222): Terminating (SIGTERM) 01:20:25.981196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23223): Terminating (SIGTERM) 01:20:26.020529 run iperf3-srv_10.42.42.10(pid=23224): Terminating (SIGTERM) 01:20:26.059519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23227): Terminating (SIGTERM) 01:20:26.099106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23230): Terminating (SIGTERM) 01:20:26.138470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23233): Terminating (SIGTERM) 01:20:26.178222 --- ParallelTerminationStrategy: PID 23217 died... 01:20:26.197465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23217): Terminated: ok {rc=0} 01:20:26.240888 --- ParallelTerminationStrategy: PID 23218 died... 01:20:26.259699 run iperf3-srv_10.42.42.10(pid=23218): Terminated {rc=256} 01:20:26.302962 --- ParallelTerminationStrategy: PID 23219 died... 01:20:26.321637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23219): Terminated: ok {rc=0} 01:20:26.365014 --- ParallelTerminationStrategy: PID 23220 died... 01:20:26.383647 run iperf3-srv_10.42.42.10(pid=23220): Terminated {rc=256} 01:20:26.426918 --- ParallelTerminationStrategy: PID 23221 died... 01:20:26.445617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23221): Terminated: ok {rc=0} 01:20:26.488809 --- ParallelTerminationStrategy: PID 23222 died... 01:20:26.507889 run iperf3-srv_10.42.42.10(pid=23222): Terminated {rc=256} 01:20:26.551001 --- ParallelTerminationStrategy: PID 23223 died... 01:20:26.569497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23223): Terminated: ok {rc=0} 01:20:26.612553 --- ParallelTerminationStrategy: PID 23224 died... 01:20:26.630998 run iperf3-srv_10.42.42.10(pid=23224): Terminated {rc=256} 01:20:26.674260 --- ParallelTerminationStrategy: PID 23227 died... 01:20:26.692781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23227): Terminated: ok {rc=0} 01:20:26.735864 --- ParallelTerminationStrategy: PID 23230 died... 01:20:26.754512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23230): Terminated: ok {rc=0} 01:20:26.797849 --- ParallelTerminationStrategy: PID 23233 died... 01:20:26.816637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23233): Terminated: ok {rc=0} 01:20:26.901747 bus /gobi_4: Setting Powered False 01:20:28.001774 bus /gobi_4: Setting Powered False 01:20:29.116073 bus /gobi_1: Setting Powered False 01:20:30.214114 bus /gobi_1: Setting Powered False 01:20:31.335337 bus /gobi_0: Setting Powered False 01:20:32.432331 bus /gobi_0: Setting Powered False 01:20:33.548160 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-umtrx ping.py ---------------------------------------------- 01:20:34.651480 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:34.663006 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 01:20:34.720354 tst ping.py: using LAC 37554 01:20:34.845424 tst ping.py: using RAC 69 01:20:34.962009 tst ping.py: using CellId 37554 01:20:35.078732 tst ping.py: using BVCI 37555 01:20:35.188116 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:35.198691 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:35.209388 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:35.219606 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:35.229869 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:35.240624 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:35.251663 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:35.263143 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:20:35.378065 tst ping.py:19: start network... 01:20:35.577949 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:20:36.037711 run create_hlr_db(pid=23235): Launched 01:20:36.160087 bus /gobi_6: Setting Powered False 01:20:37.218923 run create_hlr_db(pid=23235): Terminated: ok {rc=0} 01:20:37.655952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23237): Launched 01:20:37.977431 run osmo-hlr_10.42.42.2(pid=23238): Launched 01:20:38.101294 run osmo-stp_10.42.42.5: Starting osmo-stp 01:20:38.658676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23240): Launched 01:20:38.979629 run osmo-stp_10.42.42.5(pid=23241): Launched 01:20:39.103179 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:20:39.654424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23243): Launched 01:20:39.778536 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:20:40.048621 run patchelf(pid=23244): Launched 01:20:40.227449 run osmo-stp_10.42.42.5(pid=23241): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23241)] 01:20:40.363250 run osmo-stp_10.42.42.5(pid=23241): stdout: | (launched: 2022-12-14_01:20:38.921192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:40.500915 run osmo-stp_10.42.42.5(pid=23241): stderr: | [0;m[38;5;43m20221214012039109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012039109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012039109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012039110 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012039110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012039110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012039110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:40.638935 run osmo-stp_10.42.42.5(pid=23241): stdout: | (launched: 2022-12-14_01:20:38.921192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:40.769978 run osmo-stp_10.42.42.5(pid=23241): stderr: | [0;m[38;5;43m20221214012039109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012039109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012039109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012039110 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012039110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012039110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012039110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:40.925723 run patchelf(pid=23244): Terminating (SIGINT) 01:20:41.105311 run patchelf(pid=23244): Terminated: ok {rc=0} 01:20:41.234664 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23241): Process ended prematurely: osmo-stp_10.42.42.5(pid=23241) [trial-2397↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23241)] [trial-2397↪gprs:trx-umtrx↪ping.py:22] 01:20:41.244217 tst ping.py:22: Test FAILED (6.6 sec) 01:20:41.272305 run osmo-hlr_10.42.42.2(pid=23238): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23238)] 01:20:41.322558 run osmo-hlr_10.42.42.2(pid=23238): stdout: | (launched: 2022-12-14_01:20:37.919017) 01:20:41.374206 run osmo-hlr_10.42.42.2(pid=23238): stderr: | [0;m[1;31m20221214012038114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012038114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012038114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012038114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012038114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012038114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012038126 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012038134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012038134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012038135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:20:41.426145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23237): Terminating (SIGTERM) 01:20:41.467511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23240): Terminating (SIGTERM) 01:20:41.509239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23243): Terminating (SIGTERM) 01:20:41.551804 --- ParallelTerminationStrategy: PID 23237 died... 01:20:41.572251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23237): Terminated: ok {rc=0} 01:20:41.618417 --- ParallelTerminationStrategy: PID 23240 died... 01:20:41.638435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23240): Terminated: ok {rc=0} 01:20:41.684074 --- ParallelTerminationStrategy: PID 23243 died... 01:20:41.703758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23243): Terminated: ok {rc=0} 01:20:41.791125 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 01:20:42.874250 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:42.885673 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 01:20:42.934148 tst ping_idle_ping.py: using LAC 37555 01:20:43.053838 tst ping_idle_ping.py: using RAC 70 01:20:43.173714 tst ping_idle_ping.py: using CellId 37555 01:20:43.291975 tst ping_idle_ping.py: using BVCI 37556 01:20:43.401658 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:43.412229 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:43.422755 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:43.433184 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:43.443595 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:43.454002 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:43.464469 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 01:20:43.475012 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 01:20:43.589950 tst ping_idle_ping.py:24: start network... 01:20:43.788513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:20:44.251041 run create_hlr_db(pid=23245): Launched 01:20:44.372672 bus /gobi_6: Setting Powered False 01:20:45.432570 run create_hlr_db(pid=23245): Terminated: ok {rc=0} 01:20:45.861962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23247): Launched 01:20:46.187857 run osmo-hlr_10.42.42.2(pid=23248): Launched 01:20:46.348895 run osmo-stp_10.42.42.5: Starting osmo-stp 01:20:47.061960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23250): Launched 01:20:47.369137 run osmo-stp_10.42.42.5(pid=23251): Launched 01:20:47.510056 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:20:48.037777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23253): Launched 01:20:48.152230 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:20:48.403101 run patchelf(pid=23254): Launched 01:20:48.568684 run osmo-stp_10.42.42.5(pid=23251): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23251)] 01:20:48.693877 run osmo-stp_10.42.42.5(pid=23251): stdout: | (launched: 2022-12-14_01:20:47.313307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:48.821383 run osmo-stp_10.42.42.5(pid=23251): stderr: | [0;m[38;5;43m20221214012047513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012047513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012047513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012047514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012047514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012047514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012047514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:48.949428 run osmo-stp_10.42.42.5(pid=23251): stdout: | (launched: 2022-12-14_01:20:47.313307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:49.070345 run osmo-stp_10.42.42.5(pid=23251): stderr: | [0;m[38;5;43m20221214012047513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012047513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012047513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012047514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012047514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012047514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012047514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:20:49.214797 run patchelf(pid=23254): Terminating (SIGINT) 01:20:49.381311 run patchelf(pid=23254): Terminated: ok {rc=0} 01:20:49.500768 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23251): Process ended prematurely: osmo-stp_10.42.42.5(pid=23251) [trial-2397↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23251)] [trial-2397↪gprs:trx-umtrx↪ping_idle_ping.py:27] 01:20:49.509709 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 01:20:49.536181 run osmo-hlr_10.42.42.2(pid=23248): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23248)] 01:20:49.583029 run osmo-hlr_10.42.42.2(pid=23248): stdout: | (launched: 2022-12-14_01:20:46.129270) 01:20:49.631496 run osmo-hlr_10.42.42.2(pid=23248): stderr: | [0;m[1;31m20221214012046435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012046435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012046435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012046435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012046435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012046435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012046452 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012046460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012046460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012046460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:20:49.680476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23247): Terminating (SIGTERM) 01:20:49.719521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23250): Terminating (SIGTERM) 01:20:49.758505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23253): Terminating (SIGTERM) 01:20:49.797771 --- ParallelTerminationStrategy: PID 23247 died... 01:20:49.816752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23247): Terminated: ok {rc=0} 01:20:49.860089 --- ParallelTerminationStrategy: PID 23250 died... 01:20:49.878605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23250): Terminated: ok {rc=0} 01:20:49.921878 --- ParallelTerminationStrategy: PID 23253 died... 01:20:49.940143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23253): Terminated: ok {rc=0} 01:20:50.025967 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 01:20:51.325913 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:20:51.331076 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:20:51.362912 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:20:51.402045 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:20:51.488572 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:20:51.520762 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:20:51.559438 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:20:52.159956 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:20:52.214379 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:52.225914 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:20:52.277344 tst cs_paging_gprs_active.py: using LAC 37556 01:20:52.407245 tst cs_paging_gprs_active.py: using RAC 71 01:20:52.535929 tst cs_paging_gprs_active.py: using CellId 37556 01:20:52.665373 tst cs_paging_gprs_active.py: using BVCI 37557 01:20:52.777121 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:52.788156 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:52.799173 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:52.810209 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:52.821632 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:52.832492 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:52.843591 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:52.854325 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:20:52.865305 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:20:52.980465 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:20:53.102006 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:20:53.307315 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:53.613582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23259): Launched 01:20:53.880663 run iperf3-srv_10.42.42.10(pid=23260): Launched 01:20:53.995034 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:20:54.199753 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:20:54.506401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23261): Launched 01:20:54.774097 run iperf3-srv_10.42.42.10(pid=23262): Launched 01:20:54.890896 tst cs_paging_gprs_active.py:38: start network... 01:20:55.095717 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:20:55.570061 run create_hlr_db(pid=23263): Launched 01:20:55.694274 bus /gobi_6: Setting Powered False 01:20:56.754742 run create_hlr_db(pid=23263): Terminated: ok {rc=0} 01:20:57.178508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23265): Launched 01:20:57.483937 run osmo-hlr_10.42.42.2(pid=23266): Launched 01:20:57.599224 run osmo-stp_10.42.42.5: Starting osmo-stp 01:20:58.135395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23268): Launched 01:20:58.441365 run osmo-stp_10.42.42.5(pid=23269): Launched 01:20:58.557300 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:20:59.078838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23271): Launched 01:20:59.195200 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:20:59.451135 run patchelf(pid=23272): Launched 01:20:59.619816 run osmo-stp_10.42.42.5(pid=23269): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23269)] 01:20:59.748225 run osmo-stp_10.42.42.5(pid=23269): stdout: | (launched: 2022-12-14_01:20:58.385150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:20:59.878044 run osmo-stp_10.42.42.5(pid=23269): stderr: | [0;m[38;5;43m20221214012058551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012058551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012058551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012058551 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012058552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012058552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012058552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:00.007681 run osmo-stp_10.42.42.5(pid=23269): stdout: | (launched: 2022-12-14_01:20:58.385150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:00.131858 run osmo-stp_10.42.42.5(pid=23269): stderr: | [0;m[38;5;43m20221214012058551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012058551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012058551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012058551 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012058552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012058552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012058552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:00.279249 run patchelf(pid=23272): Terminating (SIGINT) 01:21:00.449314 run patchelf(pid=23272): Terminated: ok {rc=0} 01:21:00.571520 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23269): Process ended prematurely: osmo-stp_10.42.42.5(pid=23269) [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23269)] [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:21:00.580788 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 01:21:00.607618 run osmo-hlr_10.42.42.2(pid=23266): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23266)] 01:21:00.654194 run osmo-hlr_10.42.42.2(pid=23266): stdout: | (launched: 2022-12-14_01:20:57.426756) 01:21:00.702944 run osmo-hlr_10.42.42.2(pid=23266): stderr: | [0;m[1;31m20221214012057601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012057601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012057601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012057601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012057601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012057601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012057613 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012057623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012057623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012057624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:21:00.751940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23259): Terminating (SIGTERM) 01:21:00.790974 run iperf3-srv_10.42.42.10(pid=23260): Terminating (SIGTERM) 01:21:00.830042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23261): Terminating (SIGTERM) 01:21:00.881244 run iperf3-srv_10.42.42.10(pid=23262): Terminating (SIGTERM) 01:21:00.921073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23265): Terminating (SIGTERM) 01:21:00.961147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23268): Terminating (SIGTERM) 01:21:01.000900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23271): Terminating (SIGTERM) 01:21:01.041769 --- ParallelTerminationStrategy: PID 23259 died... 01:21:01.061366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23259): Terminated: ok {rc=0} 01:21:01.107282 --- ParallelTerminationStrategy: PID 23260 died... 01:21:01.126442 run iperf3-srv_10.42.42.10(pid=23260): Terminated {rc=256} 01:21:01.172450 --- ParallelTerminationStrategy: PID 23261 died... 01:21:01.193164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23261): Terminated: ok {rc=0} 01:21:01.239234 --- ParallelTerminationStrategy: PID 23262 died... 01:21:01.258842 run iperf3-srv_10.42.42.10(pid=23262): Terminated {rc=256} 01:21:01.304568 --- ParallelTerminationStrategy: PID 23265 died... 01:21:01.324240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23265): Terminated: ok {rc=0} 01:21:01.369109 --- ParallelTerminationStrategy: PID 23268 died... 01:21:01.388125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23268): Terminated: ok {rc=0} 01:21:01.432429 --- ParallelTerminationStrategy: PID 23271 died... 01:21:01.451674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23271): Terminated: ok {rc=0} 01:21:01.535808 bus /gobi_0: Setting Powered False 01:21:02.630619 bus /gobi_0: Setting Powered False 01:21:03.745823 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:21:04.890906 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:04.902480 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:21:04.955132 tst iperf3.py: using LAC 37557 01:21:05.076094 tst iperf3.py: using RAC 72 01:21:05.196630 tst iperf3.py: using CellId 37557 01:21:05.316578 tst iperf3.py: using BVCI 37558 01:21:05.425954 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:05.436816 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:05.447536 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:05.458265 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:05.468771 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:05.479773 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:05.490756 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:05.501513 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:05.512372 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:21:05.626960 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:21:05.830523 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:06.137079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23273): Launched 01:21:06.403287 run iperf3-srv_10.42.42.10(pid=23274): Launched 01:21:06.517664 tst iperf3.py:8: start network... 01:21:06.721080 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:21:07.190264 run create_hlr_db(pid=23275): Launched 01:21:07.315641 bus /gobi_6: Setting Powered False 01:21:08.375774 run create_hlr_db(pid=23275): Terminated: ok {rc=0} 01:21:08.796697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23277): Launched 01:21:09.098816 run osmo-hlr_10.42.42.2(pid=23278): Launched 01:21:09.213317 run osmo-stp_10.42.42.5: Starting osmo-stp 01:21:09.751751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23280): Launched 01:21:10.054535 run osmo-stp_10.42.42.5(pid=23281): Launched 01:21:10.171559 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:21:10.693221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23283): Launched 01:21:10.808877 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:21:11.064128 run patchelf(pid=23284): Launched 01:21:11.233439 run osmo-stp_10.42.42.5(pid=23281): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23281)] 01:21:11.361275 run osmo-stp_10.42.42.5(pid=23281): stdout: | (launched: 2022-12-14_01:21:09.998855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:11.491465 run osmo-stp_10.42.42.5(pid=23281): stderr: | [0;m[38;5;43m20221214012110166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012110166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012110167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012110167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012110167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012110168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012110168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:11.621459 run osmo-stp_10.42.42.5(pid=23281): stdout: | (launched: 2022-12-14_01:21:09.998855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:11.744794 run osmo-stp_10.42.42.5(pid=23281): stderr: | [0;m[38;5;43m20221214012110166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012110166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012110167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012110167 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012110167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012110168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012110168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:11.891341 run patchelf(pid=23284): Terminating (SIGINT) 01:21:12.060263 run patchelf(pid=23284): Terminated: ok {rc=0} 01:21:12.182777 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23281): Process ended prematurely: osmo-stp_10.42.42.5(pid=23281) [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23281)] [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 01:21:12.192244 tst iperf3.py:8: Test FAILED (7.3 sec) 01:21:12.219181 run osmo-hlr_10.42.42.2(pid=23278): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23278)] 01:21:12.266085 run osmo-hlr_10.42.42.2(pid=23278): stdout: | (launched: 2022-12-14_01:21:09.043077) 01:21:12.314503 run osmo-hlr_10.42.42.2(pid=23278): stderr: | [0;m[1;31m20221214012109214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012109214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012109215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012109215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012109215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012109215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012109228 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012109236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012109236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012109237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:21:12.363874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23273): Terminating (SIGTERM) 01:21:12.403209 run iperf3-srv_10.42.42.10(pid=23274): Terminating (SIGTERM) 01:21:12.442266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23277): Terminating (SIGTERM) 01:21:12.481398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23280): Terminating (SIGTERM) 01:21:12.520454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23283): Terminating (SIGTERM) 01:21:12.559806 --- ParallelTerminationStrategy: PID 23273 died... 01:21:12.578845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23273): Terminated: ok {rc=0} 01:21:12.622582 --- ParallelTerminationStrategy: PID 23274 died... 01:21:12.641301 run iperf3-srv_10.42.42.10(pid=23274): Terminated {rc=256} 01:21:12.684470 --- ParallelTerminationStrategy: PID 23277 died... 01:21:12.702796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23277): Terminated: ok {rc=0} 01:21:12.745744 --- ParallelTerminationStrategy: PID 23280 died... 01:21:12.764190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23280): Terminated: ok {rc=0} 01:21:12.807570 --- ParallelTerminationStrategy: PID 23283 died... 01:21:12.826286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23283): Terminated: ok {rc=0} 01:21:12.911220 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:21:14.057298 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:14.068802 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:21:14.120319 tst iperf3m4.py: using LAC 37558 01:21:14.241306 tst iperf3m4.py: using RAC 73 01:21:14.364091 tst iperf3m4.py: using CellId 37558 01:21:14.483326 tst iperf3m4.py: using BVCI 37559 01:21:14.594393 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:14.605524 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:14.616128 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:14.626774 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:14.638035 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:14.649347 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:14.660657 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:14.671907 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:14.683393 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:21:14.805864 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:21:14.929597 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:21:15.050095 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:21:15.168780 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:21:15.373165 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:15.679170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23285): Launched 01:21:15.949607 run iperf3-srv_10.42.42.10(pid=23286): Launched 01:21:16.103915 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:21:16.360164 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:16.675540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23287): Launched 01:21:16.958037 run iperf3-srv_10.42.42.10(pid=23288): Launched 01:21:17.088567 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:21:17.295142 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:17.599238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23289): Launched 01:21:17.864151 run iperf3-srv_10.42.42.10(pid=23290): Launched 01:21:17.977549 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:21:18.179857 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:18.485561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23291): Launched 01:21:18.751036 run iperf3-srv_10.42.42.10(pid=23292): Launched 01:21:18.864233 tst iperf3m4.py:8: start network... 01:21:19.066293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:21:19.534512 run create_hlr_db(pid=23293): Launched 01:21:19.660406 bus /gobi_6: Setting Powered False 01:21:20.720044 run create_hlr_db(pid=23293): Terminated: ok {rc=0} 01:21:21.143522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23295): Launched 01:21:21.447250 run osmo-hlr_10.42.42.2(pid=23296): Launched 01:21:21.561308 run osmo-stp_10.42.42.5: Starting osmo-stp 01:21:22.088916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23298): Launched 01:21:22.393167 run osmo-stp_10.42.42.5(pid=23299): Launched 01:21:22.509493 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:21:23.032584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23301): Launched 01:21:23.149111 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:21:23.405909 run patchelf(pid=23302): Launched 01:21:23.574940 run osmo-stp_10.42.42.5(pid=23299): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23299)] 01:21:23.703246 run osmo-stp_10.42.42.5(pid=23299): stdout: | (launched: 2022-12-14_01:21:22.336757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:23.833613 run osmo-stp_10.42.42.5(pid=23299): stderr: | [0;m[38;5;43m20221214012122506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012122506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012122507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012122507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012122508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012122508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012122508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:23.964181 run osmo-stp_10.42.42.5(pid=23299): stdout: | (launched: 2022-12-14_01:21:22.336757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:24.087820 run osmo-stp_10.42.42.5(pid=23299): stderr: | [0;m[38;5;43m20221214012122506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012122506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012122507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012122507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012122508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012122508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012122508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:24.234904 run patchelf(pid=23302): Terminating (SIGINT) 01:21:24.404270 run patchelf(pid=23302): Terminated: ok {rc=0} 01:21:24.527474 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23299): Process ended prematurely: osmo-stp_10.42.42.5(pid=23299) [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23299)] [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 01:21:24.537050 tst iperf3m4.py:8: Test FAILED (10.5 sec) 01:21:24.564345 run osmo-hlr_10.42.42.2(pid=23296): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23296)] 01:21:24.611241 run osmo-hlr_10.42.42.2(pid=23296): stdout: | (launched: 2022-12-14_01:21:21.391219) 01:21:24.660458 run osmo-hlr_10.42.42.2(pid=23296): stderr: | [0;m[1;31m20221214012121564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012121564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012121564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012121564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012121564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012121564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012121577 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012121586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012121586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012121586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:21:24.709789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23285): Terminating (SIGTERM) 01:21:24.748619 run iperf3-srv_10.42.42.10(pid=23286): Terminating (SIGTERM) 01:21:24.787504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23287): Terminating (SIGTERM) 01:21:24.826544 run iperf3-srv_10.42.42.10(pid=23288): Terminating (SIGTERM) 01:21:24.865473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23289): Terminating (SIGTERM) 01:21:24.905072 run iperf3-srv_10.42.42.10(pid=23290): Terminating (SIGTERM) 01:21:24.943867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23291): Terminating (SIGTERM) 01:21:24.982767 run iperf3-srv_10.42.42.10(pid=23292): Terminating (SIGTERM) 01:21:25.021559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23295): Terminating (SIGTERM) 01:21:25.060614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23298): Terminating (SIGTERM) 01:21:25.099602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23301): Terminating (SIGTERM) 01:21:25.138779 --- ParallelTerminationStrategy: PID 23285 died... 01:21:25.157973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23285): Terminated: ok {rc=0} 01:21:25.201414 --- ParallelTerminationStrategy: PID 23286 died... 01:21:25.219977 run iperf3-srv_10.42.42.10(pid=23286): Terminated {rc=256} 01:21:25.263243 --- ParallelTerminationStrategy: PID 23287 died... 01:21:25.281727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23287): Terminated: ok {rc=0} 01:21:25.325134 --- ParallelTerminationStrategy: PID 23288 died... 01:21:25.343668 run iperf3-srv_10.42.42.10(pid=23288): Terminated {rc=256} 01:21:25.386837 --- ParallelTerminationStrategy: PID 23289 died... 01:21:25.405448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23289): Terminated: ok {rc=0} 01:21:25.448461 --- ParallelTerminationStrategy: PID 23290 died... 01:21:25.466951 run iperf3-srv_10.42.42.10(pid=23290): Terminated {rc=256} 01:21:25.510144 --- ParallelTerminationStrategy: PID 23291 died... 01:21:25.528767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23291): Terminated: ok {rc=0} 01:21:25.571882 --- ParallelTerminationStrategy: PID 23292 died... 01:21:25.590589 run iperf3-srv_10.42.42.10(pid=23292): Terminated {rc=256} 01:21:25.633744 --- ParallelTerminationStrategy: PID 23295 died... 01:21:25.652303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23295): Terminated: ok {rc=0} 01:21:25.695824 --- ParallelTerminationStrategy: PID 23298 died... 01:21:25.714568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23298): Terminated: ok {rc=0} 01:21:25.758168 --- ParallelTerminationStrategy: PID 23301 died... 01:21:25.776743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23301): Terminated: ok {rc=0} 01:21:25.859895 bus /gobi_4: Setting Powered False 01:21:26.958014 bus /gobi_4: Setting Powered False 01:21:28.073648 bus /gobi_1: Setting Powered False 01:21:29.168622 bus /gobi_1: Setting Powered False 01:21:30.283270 bus /gobi_0: Setting Powered False 01:21:31.392424 bus /gobi_0: Setting Powered False 01:21:32.523816 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 01:21:33.626666 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:33.638927 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:21:33.690628 tst ping.py: using LAC 37559 01:21:33.816916 tst ping.py: using RAC 74 01:21:33.936197 tst ping.py: using CellId 37559 01:21:34.058648 tst ping.py: using BVCI 37560 01:21:34.168876 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:34.179985 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:34.190896 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:34.201861 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:34.213204 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:34.224708 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:34.236167 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:34.247587 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:21:34.366477 tst ping.py:19: start network... 01:21:34.582182 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:21:35.076906 run create_hlr_db(pid=23303): Launched 01:21:35.202174 bus /gobi_6: Setting Powered False 01:21:36.265342 run create_hlr_db(pid=23303): Terminated: ok {rc=0} 01:21:36.695744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23305): Launched 01:21:36.994060 run osmo-hlr_10.42.42.2(pid=23306): Launched 01:21:37.106790 run osmo-stp_10.42.42.5: Starting osmo-stp 01:21:37.638207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23308): Launched 01:21:37.934572 run osmo-stp_10.42.42.5(pid=23309): Launched 01:21:38.046662 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:21:38.555904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23311): Launched 01:21:38.670036 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:21:38.920289 run patchelf(pid=23312): Launched 01:21:39.085321 run osmo-stp_10.42.42.5(pid=23309): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23309)] 01:21:39.210721 run osmo-stp_10.42.42.5(pid=23309): stdout: | (launched: 2022-12-14_01:21:37.879121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:39.338201 run osmo-stp_10.42.42.5(pid=23309): stderr: | [0;m[38;5;43m20221214012138044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012138044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012138045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012138045 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012138046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012138046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012138046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:39.465753 run osmo-stp_10.42.42.5(pid=23309): stdout: | (launched: 2022-12-14_01:21:37.879121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:39.587109 run osmo-stp_10.42.42.5(pid=23309): stderr: | [0;m[38;5;43m20221214012138044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012138044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012138045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012138045 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012138046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012138046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012138046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:39.730951 run patchelf(pid=23312): Terminating (SIGINT) 01:21:39.896909 run patchelf(pid=23312): Terminated: ok {rc=0} 01:21:40.016200 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23309): Process ended prematurely: osmo-stp_10.42.42.5(pid=23309) [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23309)] [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 01:21:40.025768 tst ping.py:22: Test FAILED (6.4 sec) 01:21:40.052378 run osmo-hlr_10.42.42.2(pid=23306): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23306)] 01:21:40.099560 run osmo-hlr_10.42.42.2(pid=23306): stdout: | (launched: 2022-12-14_01:21:36.938971) 01:21:40.148299 run osmo-hlr_10.42.42.2(pid=23306): stderr: | [0;m[1;31m20221214012137110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012137110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012137110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012137110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012137110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012137110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012137123 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012137131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012137132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012137132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:21:40.197347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23305): Terminating (SIGTERM) 01:21:40.236633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23308): Terminating (SIGTERM) 01:21:40.276112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23311): Terminating (SIGTERM) 01:21:40.315869 --- ParallelTerminationStrategy: PID 23305 died... 01:21:40.335088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23305): Terminated: ok {rc=0} 01:21:40.378903 --- ParallelTerminationStrategy: PID 23308 died... 01:21:40.397852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23308): Terminated: ok {rc=0} 01:21:40.441105 --- ParallelTerminationStrategy: PID 23311 died... 01:21:40.459632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23311): Terminated: ok {rc=0} 01:21:40.541633 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:21:41.628268 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:41.641131 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:21:41.695702 tst ping_idle_ping.py: using LAC 37560 01:21:41.821619 tst ping_idle_ping.py: using RAC 75 01:21:41.942546 tst ping_idle_ping.py: using CellId 37560 01:21:42.067675 tst ping_idle_ping.py: using BVCI 37561 01:21:42.186299 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:42.198040 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:42.209533 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:42.220922 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:42.232673 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:42.244396 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:42.256285 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:21:42.267990 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:21:42.387212 tst ping_idle_ping.py:24: start network... 01:21:42.603290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:21:43.100823 run create_hlr_db(pid=23313): Launched 01:21:43.224909 bus /gobi_6: Setting Powered False 01:21:44.288471 run create_hlr_db(pid=23313): Terminated: ok {rc=0} 01:21:44.720755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23315): Launched 01:21:45.023367 run osmo-hlr_10.42.42.2(pid=23316): Launched 01:21:45.137646 run osmo-stp_10.42.42.5: Starting osmo-stp 01:21:45.652821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23318): Launched 01:21:45.977815 run osmo-stp_10.42.42.5(pid=23319): Launched 01:21:46.188637 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:21:46.813744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23321): Launched 01:21:46.935525 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:21:47.193772 run patchelf(pid=23322): Launched 01:21:47.376287 run osmo-stp_10.42.42.5(pid=23319): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23319)] 01:21:47.503717 run osmo-stp_10.42.42.5(pid=23319): stdout: | (launched: 2022-12-14_01:21:45.916731) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:47.632343 run osmo-stp_10.42.42.5(pid=23319): stderr: | [0;m[38;5;43m20221214012146210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012146210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012146211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012146211 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012146211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012146212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012146212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:47.761118 run osmo-stp_10.42.42.5(pid=23319): stdout: | (launched: 2022-12-14_01:21:45.916731) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:47.883561 run osmo-stp_10.42.42.5(pid=23319): stderr: | [0;m[38;5;43m20221214012146210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012146210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012146211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012146211 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012146211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012146212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012146212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:48.028457 run patchelf(pid=23322): Terminating (SIGINT) 01:21:48.195501 run patchelf(pid=23322): Terminated: ok {rc=0} 01:21:48.316262 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23319): Process ended prematurely: osmo-stp_10.42.42.5(pid=23319) [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23319)] [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 01:21:48.325518 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:21:48.352132 run osmo-hlr_10.42.42.2(pid=23316): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23316)] 01:21:48.399972 run osmo-hlr_10.42.42.2(pid=23316): stdout: | (launched: 2022-12-14_01:21:44.966594) 01:21:48.449294 run osmo-hlr_10.42.42.2(pid=23316): stderr: | [0;m[1;31m20221214012145138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012145138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012145138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012145138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012145138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012145138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012145154 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012145164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012145164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012145164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:21:48.499072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23315): Terminating (SIGTERM) 01:21:48.539041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23318): Terminating (SIGTERM) 01:21:48.579095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23321): Terminating (SIGTERM) 01:21:48.620170 --- ParallelTerminationStrategy: PID 23315 died... 01:21:48.639651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23315): Terminated: ok {rc=0} 01:21:48.683859 --- ParallelTerminationStrategy: PID 23318 died... 01:21:48.703040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23318): Terminated: ok {rc=0} 01:21:48.746992 --- ParallelTerminationStrategy: PID 23321 died... 01:21:48.766313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23321): Terminated: ok {rc=0} 01:21:48.852412 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:21:50.153296 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:21:50.159578 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:21:50.191811 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:21:50.235824 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:21:50.324347 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:21:50.357616 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:21:50.397888 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:21:50.994286 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:21:51.047777 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:51.059287 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:21:51.130928 tst cs_paging_gprs_active.py: using LAC 37561 01:21:51.259367 tst cs_paging_gprs_active.py: using RAC 76 01:21:51.392462 tst cs_paging_gprs_active.py: using CellId 37561 01:21:51.521563 tst cs_paging_gprs_active.py: using BVCI 37562 01:21:51.642574 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:51.654084 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:51.665556 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:51.676871 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:51.688476 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:51.700153 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:51.711911 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:51.723511 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:21:51.735349 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:21:51.851126 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:21:51.970179 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:21:52.192816 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:52.521695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23326): Launched 01:21:52.809349 run iperf3-srv_10.42.42.10(pid=23327): Launched 01:21:52.933265 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:21:53.154691 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:21:53.482930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23328): Launched 01:21:53.769408 run iperf3-srv_10.42.42.10(pid=23329): Launched 01:21:53.892332 tst cs_paging_gprs_active.py:38: start network... 01:21:54.114403 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:21:54.623158 run create_hlr_db(pid=23330): Launched 01:21:54.749290 bus /gobi_6: Setting Powered False 01:21:55.813692 run create_hlr_db(pid=23330): Terminated: ok {rc=0} 01:21:56.269706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23332): Launched 01:21:56.597876 run osmo-hlr_10.42.42.2(pid=23333): Launched 01:21:56.723890 run osmo-stp_10.42.42.5: Starting osmo-stp 01:21:57.284354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23335): Launched 01:21:57.612872 run osmo-stp_10.42.42.5(pid=23336): Launched 01:21:57.738548 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:21:58.300132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23338): Launched 01:21:58.427504 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:21:58.710963 run patchelf(pid=23339): Launched 01:21:58.895365 run osmo-stp_10.42.42.5(pid=23336): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23336)] 01:21:59.034710 run osmo-stp_10.42.42.5(pid=23336): stdout: | (launched: 2022-12-14_01:21:57.553002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:59.175858 run osmo-stp_10.42.42.5(pid=23336): stderr: | [0;m[38;5;43m20221214012157742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012157742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012157742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012157743 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012157743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012157743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012157743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:59.316275 run osmo-stp_10.42.42.5(pid=23336): stdout: | (launched: 2022-12-14_01:21:57.553002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:21:59.450214 run osmo-stp_10.42.42.5(pid=23336): stderr: | [0;m[38;5;43m20221214012157742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012157742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012157742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012157743 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012157743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012157743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012157743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:21:59.608721 run patchelf(pid=23339): Terminating (SIGINT) 01:21:59.792130 run patchelf(pid=23339): Terminated: ok {rc=0} 01:21:59.924502 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23336): Process ended prematurely: osmo-stp_10.42.42.5(pid=23336) [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23336)] [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:21:59.934842 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 01:21:59.963450 run osmo-hlr_10.42.42.2(pid=23333): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23333)] 01:22:00.013671 run osmo-hlr_10.42.42.2(pid=23333): stdout: | (launched: 2022-12-14_01:21:56.537825) 01:22:00.065712 run osmo-hlr_10.42.42.2(pid=23333): stderr: | [0;m[1;31m20221214012156733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012156733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012156733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012156733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012156733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012156733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012156746 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012156754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012156754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012156754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:22:00.117867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23326): Terminating (SIGTERM) 01:22:00.159925 run iperf3-srv_10.42.42.10(pid=23327): Terminating (SIGTERM) 01:22:00.202277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23328): Terminating (SIGTERM) 01:22:00.244319 run iperf3-srv_10.42.42.10(pid=23329): Terminating (SIGTERM) 01:22:00.286124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23332): Terminating (SIGTERM) 01:22:00.328428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23335): Terminating (SIGTERM) 01:22:00.370602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23338): Terminating (SIGTERM) 01:22:00.413363 --- ParallelTerminationStrategy: PID 23326 died... 01:22:00.433811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23326): Terminated: ok {rc=0} 01:22:00.480070 --- ParallelTerminationStrategy: PID 23327 died... 01:22:00.499961 run iperf3-srv_10.42.42.10(pid=23327): Terminated {rc=256} 01:22:00.546030 --- ParallelTerminationStrategy: PID 23328 died... 01:22:00.565918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23328): Terminated: ok {rc=0} 01:22:00.611877 --- ParallelTerminationStrategy: PID 23329 died... 01:22:00.631773 run iperf3-srv_10.42.42.10(pid=23329): Terminated {rc=256} 01:22:00.677562 --- ParallelTerminationStrategy: PID 23332 died... 01:22:00.697446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23332): Terminated: ok {rc=0} 01:22:00.743697 --- ParallelTerminationStrategy: PID 23335 died... 01:22:00.763723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23335): Terminated: ok {rc=0} 01:22:00.809815 --- ParallelTerminationStrategy: PID 23338 died... 01:22:00.832708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23338): Terminated: ok {rc=0} 01:22:00.929326 bus /gobi_0: Setting Powered False 01:22:02.024836 bus /gobi_0: Setting Powered False 01:22:03.143932 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:22:04.289686 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:04.301188 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:22:04.370255 tst iperf3.py: using LAC 37562 01:22:04.490678 tst iperf3.py: using RAC 77 01:22:04.610845 tst iperf3.py: using CellId 37562 01:22:04.732608 tst iperf3.py: using BVCI 37563 01:22:04.844402 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:04.855315 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:04.866042 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:04.876661 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:04.887215 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:04.897910 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:04.909083 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:04.919917 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:04.930682 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:22:05.050627 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:22:05.272290 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:05.600054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23340): Launched 01:22:05.884422 run iperf3-srv_10.42.42.10(pid=23341): Launched 01:22:06.008201 tst iperf3.py:8: start network... 01:22:06.228850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:22:06.733643 run create_hlr_db(pid=23342): Launched 01:22:06.863136 bus /gobi_6: Setting Powered False 01:22:07.923626 run create_hlr_db(pid=23342): Terminated: ok {rc=0} 01:22:08.348363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23344): Launched 01:22:08.652469 run osmo-hlr_10.42.42.2(pid=23345): Launched 01:22:08.767170 run osmo-stp_10.42.42.5: Starting osmo-stp 01:22:09.409050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23347): Launched 01:22:09.706161 run osmo-stp_10.42.42.5(pid=23348): Launched 01:22:09.818935 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:22:10.331797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23350): Launched 01:22:10.445430 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:22:10.696547 run patchelf(pid=23351): Launched 01:22:10.868380 run osmo-stp_10.42.42.5(pid=23348): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23348)] 01:22:11.003702 run osmo-stp_10.42.42.5(pid=23348): stdout: | (launched: 2022-12-14_01:22:09.650885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:11.141723 run osmo-stp_10.42.42.5(pid=23348): stderr: | [0;m[38;5;43m20221214012209817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012209817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012209817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012209818 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012209819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012209819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012209819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:11.279087 run osmo-stp_10.42.42.5(pid=23348): stdout: | (launched: 2022-12-14_01:22:09.650885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:11.409434 run osmo-stp_10.42.42.5(pid=23348): stderr: | [0;m[38;5;43m20221214012209817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012209817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012209817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012209818 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012209819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012209819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012209819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:11.563780 run patchelf(pid=23351): Terminating (SIGINT) 01:22:11.742194 run patchelf(pid=23351): Terminated: ok {rc=0} 01:22:11.871439 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23348): Process ended prematurely: osmo-stp_10.42.42.5(pid=23348) [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23348)] [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 01:22:11.881776 tst iperf3.py:8: Test FAILED (7.6 sec) 01:22:11.910164 run osmo-hlr_10.42.42.2(pid=23345): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23345)] 01:22:11.960466 run osmo-hlr_10.42.42.2(pid=23345): stdout: | (launched: 2022-12-14_01:22:08.596473) 01:22:12.012582 run osmo-hlr_10.42.42.2(pid=23345): stderr: | [0;m[1;31m20221214012208769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012208769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012208769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012208769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012208769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012208769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012208781 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012208789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012208789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012208789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:22:12.064905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23340): Terminating (SIGTERM) 01:22:12.106528 run iperf3-srv_10.42.42.10(pid=23341): Terminating (SIGTERM) 01:22:12.149173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23344): Terminating (SIGTERM) 01:22:12.191307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23347): Terminating (SIGTERM) 01:22:12.233376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23350): Terminating (SIGTERM) 01:22:12.275299 --- ParallelTerminationStrategy: PID 23340 died... 01:22:12.295727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23340): Terminated: ok {rc=0} 01:22:12.341900 --- ParallelTerminationStrategy: PID 23341 died... 01:22:12.361746 run iperf3-srv_10.42.42.10(pid=23341): Terminated {rc=256} 01:22:12.407558 --- ParallelTerminationStrategy: PID 23344 died... 01:22:12.427491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23344): Terminated: ok {rc=0} 01:22:12.473511 --- ParallelTerminationStrategy: PID 23347 died... 01:22:12.493182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23347): Terminated: ok {rc=0} 01:22:12.538933 --- ParallelTerminationStrategy: PID 23350 died... 01:22:12.558738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23350): Terminated: ok {rc=0} 01:22:12.645718 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:22:13.800005 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:13.812040 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:22:13.883271 tst iperf3m4.py: using LAC 37563 01:22:14.013140 tst iperf3m4.py: using RAC 78 01:22:14.137847 tst iperf3m4.py: using CellId 37563 01:22:14.265864 tst iperf3m4.py: using BVCI 37564 01:22:14.382942 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:14.394206 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:14.405297 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:14.416319 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:14.427720 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:14.439106 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:14.450555 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:14.461852 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:14.473649 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:22:14.589869 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:22:14.710531 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:22:14.826899 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:22:14.943037 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:22:15.141746 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:15.440909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23352): Launched 01:22:15.700684 run iperf3-srv_10.42.42.10(pid=23353): Launched 01:22:15.812235 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:22:16.051624 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:16.369792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23354): Launched 01:22:16.650624 run iperf3-srv_10.42.42.10(pid=23355): Launched 01:22:16.773835 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:22:16.976731 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:17.279772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23356): Launched 01:22:17.539704 run iperf3-srv_10.42.42.10(pid=23357): Launched 01:22:17.650404 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:22:17.847917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:18.147000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23358): Launched 01:22:18.406601 run iperf3-srv_10.42.42.10(pid=23359): Launched 01:22:18.517593 tst iperf3m4.py:8: start network... 01:22:18.715534 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:22:19.179798 run create_hlr_db(pid=23360): Launched 01:22:19.302554 bus /gobi_6: Setting Powered False 01:22:20.362259 run create_hlr_db(pid=23360): Terminated: ok {rc=0} 01:22:20.778433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23362): Launched 01:22:21.077314 run osmo-hlr_10.42.42.2(pid=23363): Launched 01:22:21.190435 run osmo-stp_10.42.42.5: Starting osmo-stp 01:22:21.716643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23366): Launched 01:22:22.013977 run osmo-stp_10.42.42.5(pid=23367): Launched 01:22:22.127149 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:22:22.639048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23369): Launched 01:22:22.753050 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:22:23.005315 run patchelf(pid=23370): Launched 01:22:23.171144 run osmo-stp_10.42.42.5(pid=23367): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23367)] 01:22:23.297849 run osmo-stp_10.42.42.5(pid=23367): stdout: | (launched: 2022-12-14_01:22:21.958446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:23.426597 run osmo-stp_10.42.42.5(pid=23367): stderr: | [0;m[38;5;43m20221214012222126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012222126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012222126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012222127 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012222127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012222127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012222127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:23.555420 run osmo-stp_10.42.42.5(pid=23367): stdout: | (launched: 2022-12-14_01:22:21.958446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:23.677415 run osmo-stp_10.42.42.5(pid=23367): stderr: | [0;m[38;5;43m20221214012222126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012222126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012222126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012222127 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012222127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012222127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012222127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:23.822084 run patchelf(pid=23370): Terminating (SIGINT) 01:22:23.988700 run patchelf(pid=23370): Terminated: ok {rc=0} 01:22:24.109434 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23367): Process ended prematurely: osmo-stp_10.42.42.5(pid=23367) [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23367)] [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:22:24.118913 tst iperf3m4.py:8: Test FAILED (10.4 sec) 01:22:24.146081 run osmo-hlr_10.42.42.2(pid=23363): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23363)] 01:22:24.193548 run osmo-hlr_10.42.42.2(pid=23363): stdout: | (launched: 2022-12-14_01:22:21.021673) 01:22:24.242289 run osmo-hlr_10.42.42.2(pid=23363): stderr: | [0;m[1;31m20221214012221192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012221192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012221193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012221193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012221193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012221193 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012221205 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012221214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012221214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012221214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:22:24.291733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23352): Terminating (SIGTERM) 01:22:24.331281 run iperf3-srv_10.42.42.10(pid=23353): Terminating (SIGTERM) 01:22:24.370904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23354): Terminating (SIGTERM) 01:22:24.410420 run iperf3-srv_10.42.42.10(pid=23355): Terminating (SIGTERM) 01:22:24.449998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23356): Terminating (SIGTERM) 01:22:24.489523 run iperf3-srv_10.42.42.10(pid=23357): Terminating (SIGTERM) 01:22:24.528886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23358): Terminating (SIGTERM) 01:22:24.568525 run iperf3-srv_10.42.42.10(pid=23359): Terminating (SIGTERM) 01:22:24.607924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23362): Terminating (SIGTERM) 01:22:24.647436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23366): Terminating (SIGTERM) 01:22:24.686882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23369): Terminating (SIGTERM) 01:22:24.726622 --- ParallelTerminationStrategy: PID 23352 died... 01:22:24.745627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23352): Terminated: ok {rc=0} 01:22:24.789455 --- ParallelTerminationStrategy: PID 23353 died... 01:22:24.808126 run iperf3-srv_10.42.42.10(pid=23353): Terminated {rc=256} 01:22:24.851647 --- ParallelTerminationStrategy: PID 23354 died... 01:22:24.870182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23354): Terminated: ok {rc=0} 01:22:24.914111 --- ParallelTerminationStrategy: PID 23355 died... 01:22:24.932938 run iperf3-srv_10.42.42.10(pid=23355): Terminated {rc=256} 01:22:24.976335 --- ParallelTerminationStrategy: PID 23356 died... 01:22:24.995031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23356): Terminated: ok {rc=0} 01:22:25.038593 --- ParallelTerminationStrategy: PID 23357 died... 01:22:25.057404 run iperf3-srv_10.42.42.10(pid=23357): Terminated {rc=256} 01:22:25.100798 --- ParallelTerminationStrategy: PID 23358 died... 01:22:25.119434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23358): Terminated: ok {rc=0} 01:22:25.163252 --- ParallelTerminationStrategy: PID 23359 died... 01:22:25.182063 run iperf3-srv_10.42.42.10(pid=23359): Terminated {rc=256} 01:22:25.225939 --- ParallelTerminationStrategy: PID 23362 died... 01:22:25.244576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23362): Terminated: ok {rc=0} 01:22:25.287978 --- ParallelTerminationStrategy: PID 23366 died... 01:22:25.306717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23366): Terminated: ok {rc=0} 01:22:25.350152 --- ParallelTerminationStrategy: PID 23369 died... 01:22:25.368805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23369): Terminated: ok {rc=0} 01:22:25.454470 bus /gobi_4: Setting Powered False 01:22:26.551677 bus /gobi_4: Setting Powered False 01:22:27.665853 bus /gobi_1: Setting Powered False 01:22:28.763131 bus /gobi_1: Setting Powered False 01:22:29.875754 bus /gobi_0: Setting Powered False 01:22:30.985126 bus /gobi_0: Setting Powered False 01:22:32.120352 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:22:33.236183 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:33.248091 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:22:33.318685 tst ping.py: using LAC 37564 01:22:33.443647 tst ping.py: using RAC 79 01:22:33.560664 tst ping.py: using CellId 37564 01:22:33.676026 tst ping.py: using BVCI 37565 01:22:33.791635 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:33.803060 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:33.814219 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:33.826608 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:33.838096 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:33.849589 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:33.861110 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:33.872353 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:22:33.987823 tst ping.py:19: start network... 01:22:34.183434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:22:34.638708 run create_hlr_db(pid=23371): Launched 01:22:34.759341 bus /gobi_6: Setting Powered False 01:22:35.818598 run create_hlr_db(pid=23371): Terminated: ok {rc=0} 01:22:36.250763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23373): Launched 01:22:36.566818 run osmo-hlr_10.42.42.2(pid=23374): Launched 01:22:36.687959 run osmo-stp_10.42.42.5: Starting osmo-stp 01:22:37.235470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23376): Launched 01:22:37.551451 run osmo-stp_10.42.42.5(pid=23377): Launched 01:22:37.671258 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:22:38.214024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23379): Launched 01:22:38.334285 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:22:38.599466 run patchelf(pid=23380): Launched 01:22:38.774273 run osmo-stp_10.42.42.5(pid=23377): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23377)] 01:22:38.907531 run osmo-stp_10.42.42.5(pid=23377): stdout: | (launched: 2022-12-14_01:22:37.493362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:39.043209 run osmo-stp_10.42.42.5(pid=23377): stderr: | [0;m[38;5;43m20221214012237681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012237681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012237682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012237682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012237683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012237683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012237683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:39.179233 run osmo-stp_10.42.42.5(pid=23377): stdout: | (launched: 2022-12-14_01:22:37.493362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:39.308313 run osmo-stp_10.42.42.5(pid=23377): stderr: | [0;m[38;5;43m20221214012237681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012237681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012237682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012237682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012237683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012237683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012237683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:39.461512 run patchelf(pid=23380): Terminating (SIGINT) 01:22:39.636886 run patchelf(pid=23380): Terminated: ok {rc=0} 01:22:39.763491 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23377): Process ended prematurely: osmo-stp_10.42.42.5(pid=23377) [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23377)] [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 01:22:39.773097 tst ping.py:22: Test FAILED (6.5 sec) 01:22:39.800888 run osmo-hlr_10.42.42.2(pid=23374): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23374)] 01:22:39.851350 run osmo-hlr_10.42.42.2(pid=23374): stdout: | (launched: 2022-12-14_01:22:36.508940) 01:22:39.903424 run osmo-hlr_10.42.42.2(pid=23374): stderr: | [0;m[1;31m20221214012236701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012236701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012236701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012236701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012236701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012236701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012236714 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012236722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012236723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012236723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:22:39.955842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23373): Terminating (SIGTERM) 01:22:39.997830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23376): Terminating (SIGTERM) 01:22:40.039617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23379): Terminating (SIGTERM) 01:22:40.082174 --- ParallelTerminationStrategy: PID 23373 died... 01:22:40.102377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23373): Terminated: ok {rc=0} 01:22:40.148481 --- ParallelTerminationStrategy: PID 23376 died... 01:22:40.168437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23376): Terminated: ok {rc=0} 01:22:40.214341 --- ParallelTerminationStrategy: PID 23379 died... 01:22:40.234144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23379): Terminated: ok {rc=0} 01:22:40.321372 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:22:41.408746 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:41.420358 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:22:41.492347 tst ping_idle_ping.py: using LAC 37565 01:22:41.607565 tst ping_idle_ping.py: using RAC 80 01:22:41.732733 tst ping_idle_ping.py: using CellId 37565 01:22:41.852632 tst ping_idle_ping.py: using BVCI 37566 01:22:41.959638 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:41.970514 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:41.981301 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:41.991830 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:42.002536 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:42.013766 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:42.024372 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:22:42.034972 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:22:42.154598 tst ping_idle_ping.py:24: start network... 01:22:42.366423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:22:42.851468 run create_hlr_db(pid=23381): Launched 01:22:42.971404 bus /gobi_6: Setting Powered False 01:22:44.033939 run create_hlr_db(pid=23381): Terminated: ok {rc=0} 01:22:44.457024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23383): Launched 01:22:44.751023 run osmo-hlr_10.42.42.2(pid=23384): Launched 01:22:44.861626 run osmo-stp_10.42.42.5: Starting osmo-stp 01:22:45.382378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23386): Launched 01:22:45.679205 run osmo-stp_10.42.42.5(pid=23387): Launched 01:22:45.791039 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:22:46.404887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23389): Launched 01:22:46.539750 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:22:46.817639 run patchelf(pid=23390): Launched 01:22:47.000322 run osmo-stp_10.42.42.5(pid=23387): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23387)] 01:22:47.127988 run osmo-stp_10.42.42.5(pid=23387): stdout: | (launched: 2022-12-14_01:22:45.623151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:47.256809 run osmo-stp_10.42.42.5(pid=23387): stderr: | [0;m[38;5;43m20221214012245789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012245789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012245789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012245789 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012245790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012245790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012245790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:47.383332 run osmo-stp_10.42.42.5(pid=23387): stdout: | (launched: 2022-12-14_01:22:45.623151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:47.503789 run osmo-stp_10.42.42.5(pid=23387): stderr: | [0;m[38;5;43m20221214012245789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012245789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012245789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012245789 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012245790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012245790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012245790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:47.646158 run patchelf(pid=23390): Terminating (SIGINT) 01:22:47.811833 run patchelf(pid=23390): Terminated: ok {rc=0} 01:22:47.931283 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23387): Process ended prematurely: osmo-stp_10.42.42.5(pid=23387) [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23387)] [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:22:47.940375 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 01:22:47.967231 run osmo-hlr_10.42.42.2(pid=23384): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23384)] 01:22:48.014788 run osmo-hlr_10.42.42.2(pid=23384): stdout: | (launched: 2022-12-14_01:22:44.696528) 01:22:48.064021 run osmo-hlr_10.42.42.2(pid=23384): stderr: | [0;m[1;31m20221214012244869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012244869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012244869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012244869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012244869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012244869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012244881 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012244890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012244890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012244890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:22:48.113611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23383): Terminating (SIGTERM) 01:22:48.153255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23386): Terminating (SIGTERM) 01:22:48.193426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23389): Terminating (SIGTERM) 01:22:48.233337 --- ParallelTerminationStrategy: PID 23383 died... 01:22:48.252257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23383): Terminated: ok {rc=0} 01:22:48.296173 --- ParallelTerminationStrategy: PID 23386 died... 01:22:48.314709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23386): Terminated: ok {rc=0} 01:22:48.358218 --- ParallelTerminationStrategy: PID 23389 died... 01:22:48.376597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23389): Terminated: ok {rc=0} 01:22:48.461960 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:22:49.766037 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:22:49.772314 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:22:49.804653 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 01:22:49.843377 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 01:22:49.930019 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:22:49.962097 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 01:22:49.999954 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 01:22:50.594298 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 01:22:50.642115 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:50.652902 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:22:50.725265 tst cs_paging_gprs_active.py: using LAC 37566 01:22:50.842393 tst cs_paging_gprs_active.py: using RAC 81 01:22:50.959150 tst cs_paging_gprs_active.py: using CellId 37566 01:22:51.075052 tst cs_paging_gprs_active.py: using BVCI 37567 01:22:51.183810 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:51.194710 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:51.205402 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:51.216069 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:51.226675 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:51.237359 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:51.248089 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:51.258753 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:22:51.269600 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:22:51.389785 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:22:51.511790 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:22:51.729777 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:52.053780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23395): Launched 01:22:52.335866 run iperf3-srv_10.42.42.10(pid=23396): Launched 01:22:52.458950 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:22:52.676523 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:22:53.000127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23397): Launched 01:22:53.282225 run iperf3-srv_10.42.42.10(pid=23398): Launched 01:22:53.405060 tst cs_paging_gprs_active.py:38: start network... 01:22:53.622319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:22:54.121365 run create_hlr_db(pid=23399): Launched 01:22:54.247374 bus /gobi_6: Setting Powered False 01:22:55.310633 run create_hlr_db(pid=23399): Terminated: ok {rc=0} 01:22:55.742175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23401): Launched 01:22:56.042552 run osmo-hlr_10.42.42.2(pid=23402): Launched 01:22:56.156166 run osmo-stp_10.42.42.5: Starting osmo-stp 01:22:56.691333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23404): Launched 01:22:56.990696 run osmo-stp_10.42.42.5(pid=23405): Launched 01:22:57.104385 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:22:57.622526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23407): Launched 01:22:57.737409 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:22:57.993852 run patchelf(pid=23408): Launched 01:22:58.161708 run osmo-stp_10.42.42.5(pid=23405): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23405)] 01:22:58.289263 run osmo-stp_10.42.42.5(pid=23405): stdout: | (launched: 2022-12-14_01:22:56.934968) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:58.417732 run osmo-stp_10.42.42.5(pid=23405): stderr: | [0;m[38;5;43m20221214012257103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012257103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012257103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012257104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012257104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012257104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012257104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:58.546441 run osmo-stp_10.42.42.5(pid=23405): stdout: | (launched: 2022-12-14_01:22:56.934968) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:22:58.669154 run osmo-stp_10.42.42.5(pid=23405): stderr: | [0;m[38;5;43m20221214012257103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012257103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012257103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012257104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012257104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012257104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012257104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:22:58.814608 run patchelf(pid=23408): Terminating (SIGINT) 01:22:58.983388 run patchelf(pid=23408): Terminated: ok {rc=0} 01:22:59.104581 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23405): Process ended prematurely: osmo-stp_10.42.42.5(pid=23405) [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23405)] [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 01:22:59.114309 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 01:22:59.140864 run osmo-hlr_10.42.42.2(pid=23402): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23402)] 01:22:59.188380 run osmo-hlr_10.42.42.2(pid=23402): stdout: | (launched: 2022-12-14_01:22:55.987478) 01:22:59.237121 run osmo-hlr_10.42.42.2(pid=23402): stderr: | [0;m[1;31m20221214012256158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012256158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012256158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012256158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012256158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012256158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012256170 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012256181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012256181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012256181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:22:59.286063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23395): Terminating (SIGTERM) 01:22:59.324861 run iperf3-srv_10.42.42.10(pid=23396): Terminating (SIGTERM) 01:22:59.363544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23397): Terminating (SIGTERM) 01:22:59.402185 run iperf3-srv_10.42.42.10(pid=23398): Terminating (SIGTERM) 01:22:59.441025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23401): Terminating (SIGTERM) 01:22:59.479855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23404): Terminating (SIGTERM) 01:22:59.518688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23407): Terminating (SIGTERM) 01:22:59.557720 --- ParallelTerminationStrategy: PID 23395 died... 01:22:59.576563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23395): Terminated: ok {rc=0} 01:22:59.619797 --- ParallelTerminationStrategy: PID 23396 died... 01:22:59.638437 run iperf3-srv_10.42.42.10(pid=23396): Terminated {rc=256} 01:22:59.681548 --- ParallelTerminationStrategy: PID 23397 died... 01:22:59.700430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23397): Terminated: ok {rc=0} 01:22:59.743491 --- ParallelTerminationStrategy: PID 23398 died... 01:22:59.761681 run iperf3-srv_10.42.42.10(pid=23398): Terminated {rc=256} 01:22:59.804648 --- ParallelTerminationStrategy: PID 23401 died... 01:22:59.823191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23401): Terminated: ok {rc=0} 01:22:59.866181 --- ParallelTerminationStrategy: PID 23404 died... 01:22:59.884521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23404): Terminated: ok {rc=0} 01:22:59.928345 --- ParallelTerminationStrategy: PID 23407 died... 01:22:59.946875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23407): Terminated: ok {rc=0} 01:23:00.031716 bus /gobi_0: Setting Powered False 01:23:01.138701 bus /gobi_0: Setting Powered False 01:23:02.264659 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 01:23:03.413057 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:03.425166 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:23:03.498507 tst iperf3.py: using LAC 37567 01:23:03.625334 tst iperf3.py: using RAC 82 01:23:03.743588 tst iperf3.py: using CellId 37567 01:23:03.861720 tst iperf3.py: using BVCI 37568 01:23:03.971351 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:03.982448 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:03.993131 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:04.003868 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:04.014465 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:04.025170 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:04.035913 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:04.046506 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:04.057347 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:23:04.171460 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:23:04.370769 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:04.670294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23409): Launched 01:23:04.930581 run iperf3-srv_10.42.42.10(pid=23410): Launched 01:23:05.042251 tst iperf3.py:8: start network... 01:23:05.241861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:23:05.702668 run create_hlr_db(pid=23411): Launched 01:23:05.826746 bus /gobi_6: Setting Powered False 01:23:06.885793 run create_hlr_db(pid=23411): Terminated: ok {rc=0} 01:23:07.324857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23413): Launched 01:23:07.645460 run osmo-hlr_10.42.42.2(pid=23414): Launched 01:23:07.770312 run osmo-stp_10.42.42.5: Starting osmo-stp 01:23:08.326696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23416): Launched 01:23:08.647481 run osmo-stp_10.42.42.5(pid=23417): Launched 01:23:08.771133 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:23:09.323919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23419): Launched 01:23:09.447058 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:23:09.716881 run patchelf(pid=23420): Launched 01:23:09.894798 run osmo-stp_10.42.42.5(pid=23417): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23417)] 01:23:10.030316 run osmo-stp_10.42.42.5(pid=23417): stdout: | (launched: 2022-12-14_01:23:08.588378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:10.167977 run osmo-stp_10.42.42.5(pid=23417): stderr: | [0;m[38;5;43m20221214012308775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012308775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012308775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012308776 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012308776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012308776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012308776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:10.305885 run osmo-stp_10.42.42.5(pid=23417): stdout: | (launched: 2022-12-14_01:23:08.588378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:10.436831 run osmo-stp_10.42.42.5(pid=23417): stderr: | [0;m[38;5;43m20221214012308775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012308775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012308775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012308776 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012308776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012308776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012308776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:10.591978 run patchelf(pid=23420): Terminating (SIGINT) 01:23:10.771304 run patchelf(pid=23420): Terminated: ok {rc=0} 01:23:10.901170 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23417): Process ended prematurely: osmo-stp_10.42.42.5(pid=23417) [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23417)] [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 01:23:10.911385 tst iperf3.py:8: Test FAILED (7.5 sec) 01:23:10.940144 run osmo-hlr_10.42.42.2(pid=23414): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23414)] 01:23:10.990247 run osmo-hlr_10.42.42.2(pid=23414): stdout: | (launched: 2022-12-14_01:23:07.587066) 01:23:11.041866 run osmo-hlr_10.42.42.2(pid=23414): stderr: | [0;m[1;31m20221214012307779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012307779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012307779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012307779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012307779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012307779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012307794 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012307803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012307804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012307804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:23:11.094281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23409): Terminating (SIGTERM) 01:23:11.135589 run iperf3-srv_10.42.42.10(pid=23410): Terminating (SIGTERM) 01:23:11.178273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23413): Terminating (SIGTERM) 01:23:11.220159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23416): Terminating (SIGTERM) 01:23:11.261972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23419): Terminating (SIGTERM) 01:23:11.303800 --- ParallelTerminationStrategy: PID 23409 died... 01:23:11.324281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23409): Terminated: ok {rc=0} 01:23:11.370393 --- ParallelTerminationStrategy: PID 23410 died... 01:23:11.389956 run iperf3-srv_10.42.42.10(pid=23410): Terminated {rc=256} 01:23:11.436015 --- ParallelTerminationStrategy: PID 23413 died... 01:23:11.455792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23413): Terminated: ok {rc=0} 01:23:11.501829 --- ParallelTerminationStrategy: PID 23416 died... 01:23:11.521613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23416): Terminated: ok {rc=0} 01:23:11.567653 --- ParallelTerminationStrategy: PID 23419 died... 01:23:11.587552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23419): Terminated: ok {rc=0} 01:23:11.675791 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 01:23:12.824225 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:12.836369 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:23:12.906788 tst iperf3m4.py: using LAC 37568 01:23:13.030457 tst iperf3m4.py: using RAC 83 01:23:13.154378 tst iperf3m4.py: using CellId 37568 01:23:13.281396 tst iperf3m4.py: using BVCI 37569 01:23:13.399172 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:13.410589 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:13.421807 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:13.433068 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:13.444411 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:13.455957 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:13.467640 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:13.479106 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:13.490802 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:23:13.607368 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:23:13.729414 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:23:13.844555 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:23:13.963023 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:23:14.179841 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:14.502366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23421): Launched 01:23:14.783103 run iperf3-srv_10.42.42.10(pid=23422): Launched 01:23:14.903097 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:23:15.118319 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:15.441275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23423): Launched 01:23:15.720338 run iperf3-srv_10.42.42.10(pid=23424): Launched 01:23:15.852829 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:23:16.090118 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:16.418879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23425): Launched 01:23:16.712433 run iperf3-srv_10.42.42.10(pid=23426): Launched 01:23:16.847946 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:23:17.068527 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:17.394535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23427): Launched 01:23:17.675279 run iperf3-srv_10.42.42.10(pid=23428): Launched 01:23:17.795155 tst iperf3m4.py:8: start network... 01:23:18.009996 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:23:18.507655 run create_hlr_db(pid=23429): Launched 01:23:18.631358 bus /gobi_6: Setting Powered False 01:23:19.694437 run create_hlr_db(pid=23429): Terminated: ok {rc=0} 01:23:20.122663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23431): Launched 01:23:20.421752 run osmo-hlr_10.42.42.2(pid=23432): Launched 01:23:20.535294 run osmo-stp_10.42.42.5: Starting osmo-stp 01:23:21.065053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23434): Launched 01:23:21.363852 run osmo-stp_10.42.42.5(pid=23435): Launched 01:23:21.477419 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:23:21.994965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23437): Launched 01:23:22.109902 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:23:22.361875 run patchelf(pid=23438): Launched 01:23:22.527828 run osmo-stp_10.42.42.5(pid=23435): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23435)] 01:23:22.654106 run osmo-stp_10.42.42.5(pid=23435): stdout: | (launched: 2022-12-14_01:23:21.308558) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:22.782476 run osmo-stp_10.42.42.5(pid=23435): stderr: | [0;m[38;5;43m20221214012321475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012321475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012321475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012321476 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012321476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012321476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012321476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:22.911071 run osmo-stp_10.42.42.5(pid=23435): stdout: | (launched: 2022-12-14_01:23:21.308558) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:23.032441 run osmo-stp_10.42.42.5(pid=23435): stderr: | [0;m[38;5;43m20221214012321475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012321475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012321475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012321476 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012321476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012321476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012321476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:23.176534 run patchelf(pid=23438): Terminating (SIGINT) 01:23:23.343697 run patchelf(pid=23438): Terminated: ok {rc=0} 01:23:23.465261 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23435): Process ended prematurely: osmo-stp_10.42.42.5(pid=23435) [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23435)] [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 01:23:23.474748 tst iperf3m4.py:8: Test FAILED (10.7 sec) 01:23:23.501821 run osmo-hlr_10.42.42.2(pid=23432): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23432)] 01:23:23.548738 run osmo-hlr_10.42.42.2(pid=23432): stdout: | (launched: 2022-12-14_01:23:20.366080) 01:23:23.597521 run osmo-hlr_10.42.42.2(pid=23432): stderr: | [0;m[1;31m20221214012320537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012320537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012320537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012320537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012320537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012320537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012320549 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012320557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012320557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012320557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:23:23.646511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23421): Terminating (SIGTERM) 01:23:23.685377 run iperf3-srv_10.42.42.10(pid=23422): Terminating (SIGTERM) 01:23:23.724208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23423): Terminating (SIGTERM) 01:23:23.763004 run iperf3-srv_10.42.42.10(pid=23424): Terminating (SIGTERM) 01:23:23.801937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23425): Terminating (SIGTERM) 01:23:23.840793 run iperf3-srv_10.42.42.10(pid=23426): Terminating (SIGTERM) 01:23:23.879573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23427): Terminating (SIGTERM) 01:23:23.918534 run iperf3-srv_10.42.42.10(pid=23428): Terminating (SIGTERM) 01:23:23.958647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23431): Terminating (SIGTERM) 01:23:23.998739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23434): Terminating (SIGTERM) 01:23:24.037971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23437): Terminating (SIGTERM) 01:23:24.077641 --- ParallelTerminationStrategy: PID 23421 died... 01:23:24.096541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23421): Terminated: ok {rc=0} 01:23:24.140180 --- ParallelTerminationStrategy: PID 23422 died... 01:23:24.158627 run iperf3-srv_10.42.42.10(pid=23422): Terminated {rc=256} 01:23:24.201533 --- ParallelTerminationStrategy: PID 23423 died... 01:23:24.219807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23423): Terminated: ok {rc=0} 01:23:24.263173 --- ParallelTerminationStrategy: PID 23424 died... 01:23:24.281626 run iperf3-srv_10.42.42.10(pid=23424): Terminated {rc=256} 01:23:24.324859 --- ParallelTerminationStrategy: PID 23425 died... 01:23:24.343547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23425): Terminated: ok {rc=0} 01:23:24.386870 --- ParallelTerminationStrategy: PID 23426 died... 01:23:24.405308 run iperf3-srv_10.42.42.10(pid=23426): Terminated {rc=256} 01:23:24.448436 --- ParallelTerminationStrategy: PID 23427 died... 01:23:24.466707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23427): Terminated: ok {rc=0} 01:23:24.510025 --- ParallelTerminationStrategy: PID 23428 died... 01:23:24.528469 run iperf3-srv_10.42.42.10(pid=23428): Terminated {rc=256} 01:23:24.571596 --- ParallelTerminationStrategy: PID 23431 died... 01:23:24.589859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23431): Terminated: ok {rc=0} 01:23:24.632581 --- ParallelTerminationStrategy: PID 23434 died... 01:23:24.650831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23434): Terminated: ok {rc=0} 01:23:24.693680 --- ParallelTerminationStrategy: PID 23437 died... 01:23:24.712097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23437): Terminated: ok {rc=0} 01:23:24.796921 bus /gobi_4: Setting Powered False 01:23:25.895880 bus /gobi_4: Setting Powered False 01:23:27.008926 bus /gobi_1: Setting Powered False 01:23:28.106461 bus /gobi_1: Setting Powered False 01:23:29.222246 bus /gobi_0: Setting Powered False 01:23:30.319117 bus /gobi_0: Setting Powered False 01:23:31.432624 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 01:23:32.533555 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:32.544922 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:23:32.614249 tst ping.py: using LAC 37569 01:23:32.730670 tst ping.py: using RAC 84 01:23:32.847069 tst ping.py: using CellId 37569 01:23:32.962347 tst ping.py: using BVCI 37570 01:23:33.071033 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:33.081945 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:33.092611 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:33.103332 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:33.113998 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:33.124624 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:33.135455 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:33.146117 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:23:33.259261 tst ping.py:19: start network... 01:23:33.454478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:23:33.908434 run create_hlr_db(pid=23439): Launched 01:23:34.027700 bus /gobi_6: Setting Powered False 01:23:35.086411 run create_hlr_db(pid=23439): Terminated: ok {rc=0} 01:23:35.498169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23441): Launched 01:23:35.790368 run osmo-hlr_10.42.42.2(pid=23442): Launched 01:23:35.901165 run osmo-stp_10.42.42.5: Starting osmo-stp 01:23:36.424618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23444): Launched 01:23:36.717590 run osmo-stp_10.42.42.5(pid=23445): Launched 01:23:36.828685 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:23:37.337680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23447): Launched 01:23:37.450013 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:23:37.699122 run patchelf(pid=23448): Launched 01:23:37.861293 run osmo-stp_10.42.42.5(pid=23445): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23445)] 01:23:37.985318 run osmo-stp_10.42.42.5(pid=23445): stdout: | (launched: 2022-12-14_01:23:36.662755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:38.111624 run osmo-stp_10.42.42.5(pid=23445): stderr: | [0;m[38;5;43m20221214012336828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012336828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012336829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012336829 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012336830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012336830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012336830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:38.238107 run osmo-stp_10.42.42.5(pid=23445): stdout: | (launched: 2022-12-14_01:23:36.662755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:38.357930 run osmo-stp_10.42.42.5(pid=23445): stderr: | [0;m[38;5;43m20221214012336828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012336828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012336829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012336829 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012336830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012336830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012336830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:38.500024 run patchelf(pid=23448): Terminating (SIGINT) 01:23:38.664144 run patchelf(pid=23448): Terminated: ok {rc=0} 01:23:38.782486 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23445): Process ended prematurely: osmo-stp_10.42.42.5(pid=23445) [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23445)] [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 01:23:38.791391 tst ping.py:22: Test FAILED (6.3 sec) 01:23:38.817933 run osmo-hlr_10.42.42.2(pid=23442): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23442)] 01:23:38.864767 run osmo-hlr_10.42.42.2(pid=23442): stdout: | (launched: 2022-12-14_01:23:35.736269) 01:23:38.913290 run osmo-hlr_10.42.42.2(pid=23442): stderr: | [0;m[1;31m20221214012335907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012335907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012335907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012335907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012335907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012335907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012335920 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012335930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012335930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012335930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:23:38.962336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23441): Terminating (SIGTERM) 01:23:39.001582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23444): Terminating (SIGTERM) 01:23:39.040779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23447): Terminating (SIGTERM) 01:23:39.080351 --- ParallelTerminationStrategy: PID 23441 died... 01:23:39.099240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23441): Terminated: ok {rc=0} 01:23:39.142766 --- ParallelTerminationStrategy: PID 23444 died... 01:23:39.161204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23444): Terminated: ok {rc=0} 01:23:39.204267 --- ParallelTerminationStrategy: PID 23447 died... 01:23:39.222748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23447): Terminated: ok {rc=0} 01:23:39.305068 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 01:23:40.391402 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:40.404053 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:23:40.480413 tst ping_idle_ping.py: using LAC 37570 01:23:40.605370 tst ping_idle_ping.py: using RAC 85 01:23:40.730935 tst ping_idle_ping.py: using CellId 37570 01:23:40.854162 tst ping_idle_ping.py: using BVCI 37571 01:23:40.968586 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:40.979980 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:40.991322 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:41.002698 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:41.014156 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:41.025746 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:41.037422 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:23:41.048907 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:23:41.167713 tst ping_idle_ping.py:24: start network... 01:23:41.380009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:23:41.867801 run create_hlr_db(pid=23449): Launched 01:23:41.989415 bus /gobi_6: Setting Powered False 01:23:43.051376 run create_hlr_db(pid=23449): Terminated: ok {rc=0} 01:23:43.475140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23451): Launched 01:23:43.770826 run osmo-hlr_10.42.42.2(pid=23452): Launched 01:23:43.882739 run osmo-stp_10.42.42.5: Starting osmo-stp 01:23:44.390323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23454): Launched 01:23:44.686704 run osmo-stp_10.42.42.5(pid=23455): Launched 01:23:44.798655 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:23:45.304772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23457): Launched 01:23:45.417173 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:23:45.665241 run patchelf(pid=23458): Launched 01:23:45.830030 run osmo-stp_10.42.42.5(pid=23455): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23455)] 01:23:45.982386 run osmo-stp_10.42.42.5(pid=23455): stdout: | (launched: 2022-12-14_01:23:44.632377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:46.117995 run osmo-stp_10.42.42.5(pid=23455): stderr: | [0;m[38;5;43m20221214012344797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012344797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012344798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012344798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012344798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012344799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012344799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:46.247634 run osmo-stp_10.42.42.5(pid=23455): stdout: | (launched: 2022-12-14_01:23:44.632377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:46.371160 run osmo-stp_10.42.42.5(pid=23455): stderr: | [0;m[38;5;43m20221214012344797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012344797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012344798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012344798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012344798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012344799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012344799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:46.517284 run patchelf(pid=23458): Terminating (SIGINT) 01:23:46.686307 run patchelf(pid=23458): Terminated: ok {rc=0} 01:23:46.808731 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23455): Process ended prematurely: osmo-stp_10.42.42.5(pid=23455) [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23455)] [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 01:23:46.818329 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 01:23:46.845626 run osmo-hlr_10.42.42.2(pid=23452): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23452)] 01:23:46.893431 run osmo-hlr_10.42.42.2(pid=23452): stdout: | (launched: 2022-12-14_01:23:43.716545) 01:23:46.943239 run osmo-hlr_10.42.42.2(pid=23452): stderr: | [0;m[1;31m20221214012343888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012343888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012343888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012343888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012343888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012343888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012343903 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012343912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012343912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012343912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:23:46.993171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23451): Terminating (SIGTERM) 01:23:47.034778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23454): Terminating (SIGTERM) 01:23:47.084253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23457): Terminating (SIGTERM) 01:23:47.133836 --- ParallelTerminationStrategy: PID 23451 died... 01:23:47.153417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23451): Terminated: ok {rc=0} 01:23:47.198102 --- ParallelTerminationStrategy: PID 23454 died... 01:23:47.217178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23454): Terminated: ok {rc=0} 01:23:47.261404 --- ParallelTerminationStrategy: PID 23457 died... 01:23:47.279979 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23457): Terminated: ok {rc=0} 01:23:47.363670 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 01:23:48.667880 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:23:48.675368 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 01:23:48.709489 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 01:23:48.749166 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 01:23:48.838058 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 01:23:48.870887 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 01:23:48.910286 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 01:23:49.519705 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 01:23:49.571714 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:49.583565 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:23:49.636744 tst cs_paging_gprs_active.py: using LAC 37571 01:23:49.763740 tst cs_paging_gprs_active.py: using RAC 86 01:23:49.889380 tst cs_paging_gprs_active.py: using CellId 37571 01:23:50.014276 tst cs_paging_gprs_active.py: using BVCI 37572 01:23:50.133196 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:50.144807 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:50.156362 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:50.167935 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:50.179865 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:50.192011 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:50.203934 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:50.215648 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:23:50.227869 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:23:50.353075 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:23:50.471615 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:23:50.689287 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:51.011848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23469): Launched 01:23:51.294048 run iperf3-srv_10.42.42.10(pid=23470): Launched 01:23:51.414631 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:23:51.632477 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:23:51.955725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23471): Launched 01:23:52.238086 run iperf3-srv_10.42.42.10(pid=23472): Launched 01:23:52.358758 tst cs_paging_gprs_active.py:38: start network... 01:23:52.575906 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:23:53.074252 run create_hlr_db(pid=23473): Launched 01:23:53.198960 bus /gobi_6: Setting Powered False 01:23:54.263419 run create_hlr_db(pid=23473): Terminated: ok {rc=0} 01:23:54.693574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23475): Launched 01:23:54.997155 run osmo-hlr_10.42.42.2(pid=23476): Launched 01:23:55.111502 run osmo-stp_10.42.42.5: Starting osmo-stp 01:23:55.631886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23478): Launched 01:23:55.932817 run osmo-stp_10.42.42.5(pid=23479): Launched 01:23:56.047577 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:23:56.566361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23481): Launched 01:23:56.680858 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:23:56.934366 run patchelf(pid=23482): Launched 01:23:57.101468 run osmo-stp_10.42.42.5(pid=23479): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23479)] 01:23:57.228379 run osmo-stp_10.42.42.5(pid=23479): stdout: | (launched: 2022-12-14_01:23:55.877135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:57.357079 run osmo-stp_10.42.42.5(pid=23479): stderr: | [0;m[38;5;43m20221214012356045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012356045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012356045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012356046 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012356046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012356046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012356046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:57.485243 run osmo-stp_10.42.42.5(pid=23479): stdout: | (launched: 2022-12-14_01:23:55.877135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:23:57.607898 run osmo-stp_10.42.42.5(pid=23479): stderr: | [0;m[38;5;43m20221214012356045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012356045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012356045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012356046 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012356046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012356046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012356046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:23:57.753816 run patchelf(pid=23482): Terminating (SIGINT) 01:23:57.921798 run patchelf(pid=23482): Terminated: ok {rc=0} 01:23:58.042471 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23479): Process ended prematurely: osmo-stp_10.42.42.5(pid=23479) [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23479)] [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 01:23:58.051862 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 01:23:58.078805 run osmo-hlr_10.42.42.2(pid=23476): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23476)] 01:23:58.126379 run osmo-hlr_10.42.42.2(pid=23476): stdout: | (launched: 2022-12-14_01:23:54.940488) 01:23:58.175227 run osmo-hlr_10.42.42.2(pid=23476): stderr: | [0;m[1;31m20221214012355114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012355114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012355115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012355115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012355115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012355115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012355127 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012355137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012355137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012355137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:23:58.224589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23469): Terminating (SIGTERM) 01:23:58.263914 run iperf3-srv_10.42.42.10(pid=23470): Terminating (SIGTERM) 01:23:58.303290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23471): Terminating (SIGTERM) 01:23:58.342764 run iperf3-srv_10.42.42.10(pid=23472): Terminating (SIGTERM) 01:23:58.382021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23475): Terminating (SIGTERM) 01:23:58.421442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23478): Terminating (SIGTERM) 01:23:58.460637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23481): Terminating (SIGTERM) 01:23:58.500040 --- ParallelTerminationStrategy: PID 23469 died... 01:23:58.519060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23469): Terminated: ok {rc=0} 01:23:58.562609 --- ParallelTerminationStrategy: PID 23470 died... 01:23:58.580836 run iperf3-srv_10.42.42.10(pid=23470): Terminated {rc=256} 01:23:58.624403 --- ParallelTerminationStrategy: PID 23471 died... 01:23:58.643012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23471): Terminated: ok {rc=0} 01:23:58.686259 --- ParallelTerminationStrategy: PID 23472 died... 01:23:58.704551 run iperf3-srv_10.42.42.10(pid=23472): Terminated {rc=256} 01:23:58.747664 --- ParallelTerminationStrategy: PID 23475 died... 01:23:58.766016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23475): Terminated: ok {rc=0} 01:23:58.809369 --- ParallelTerminationStrategy: PID 23478 died... 01:23:58.827692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23478): Terminated: ok {rc=0} 01:23:58.871462 --- ParallelTerminationStrategy: PID 23481 died... 01:23:58.889964 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23481): Terminated: ok {rc=0} 01:23:58.974269 bus /gobi_0: Setting Powered False 01:24:00.074978 bus /gobi_0: Setting Powered False 01:24:01.197689 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 01:24:02.403672 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:02.424667 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:24:02.507097 tst iperf3.py: using LAC 37572 01:24:02.674180 tst iperf3.py: using RAC 87 01:24:02.842696 tst iperf3.py: using CellId 37572 01:24:02.996080 tst iperf3.py: using BVCI 37573 01:24:03.144845 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:03.163197 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:03.175995 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:03.190308 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:03.208845 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:03.226401 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:03.242629 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:03.256372 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:03.272813 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:24:03.404771 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:24:03.674452 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:24:04.033191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23752): Launched 01:24:04.310945 run iperf3-srv_10.42.42.10(pid=23753): Launched 01:24:04.450347 tst iperf3.py:8: start network... 01:24:04.675002 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:24:05.186410 run create_hlr_db(pid=23754): Launched 01:24:05.352332 bus /gobi_6: Setting Powered False 01:24:06.415356 run create_hlr_db(pid=23754): Terminated: ok {rc=0} 01:24:06.880177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23758): Launched 01:24:07.194518 run osmo-hlr_10.42.42.2(pid=23759): Launched 01:24:07.420088 run osmo-stp_10.42.42.5: Starting osmo-stp 01:24:08.149052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23761): Launched 01:24:08.473720 run osmo-stp_10.42.42.5(pid=23762): Launched 01:24:08.729247 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:24:09.361396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23764): Launched 01:24:09.499593 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:24:09.782865 run patchelf(pid=23765): Launched 01:24:09.982482 run osmo-stp_10.42.42.5(pid=23762): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23762)] 01:24:10.125326 run osmo-stp_10.42.42.5(pid=23762): stdout: | (launched: 2022-12-14_01:24:08.407835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:10.270295 run osmo-stp_10.42.42.5(pid=23762): stderr: | [0;m[38;5;43m20221214012408704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012408704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012408704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012408704 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012408705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012408705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012408705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:10.414586 run osmo-stp_10.42.42.5(pid=23762): stdout: | (launched: 2022-12-14_01:24:08.407835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:10.551935 run osmo-stp_10.42.42.5(pid=23762): stderr: | [0;m[38;5;43m20221214012408704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012408704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012408704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012408704 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012408705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012408705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012408705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:10.715503 run patchelf(pid=23765): Terminating (SIGINT) 01:24:10.904824 run patchelf(pid=23765): Terminated: ok {rc=0} 01:24:11.040080 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23762): Process ended prematurely: osmo-stp_10.42.42.5(pid=23762) [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23762)] [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 01:24:11.052882 tst iperf3.py:8: Test FAILED (8.7 sec) 01:24:11.084096 run osmo-hlr_10.42.42.2(pid=23759): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23759)] 01:24:11.137440 run osmo-hlr_10.42.42.2(pid=23759): stdout: | (launched: 2022-12-14_01:24:07.138206) 01:24:11.191947 run osmo-hlr_10.42.42.2(pid=23759): stderr: | [0;m[1;31m20221214012407474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012407474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012407475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012407475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012407475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012407475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012407495 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012407512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012407512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012407512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:24:11.247944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23752): Terminating (SIGTERM) 01:24:11.291421 run iperf3-srv_10.42.42.10(pid=23753): Terminating (SIGTERM) 01:24:11.339130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23758): Terminating (SIGTERM) 01:24:11.384308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23761): Terminating (SIGTERM) 01:24:11.430309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23764): Terminating (SIGTERM) 01:24:11.476393 --- ParallelTerminationStrategy: PID 23752 died... 01:24:11.498391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23752): Terminated: ok {rc=0} 01:24:11.548619 --- ParallelTerminationStrategy: PID 23753 died... 01:24:11.570946 run iperf3-srv_10.42.42.10(pid=23753): Terminated {rc=256} 01:24:11.619728 --- ParallelTerminationStrategy: PID 23758 died... 01:24:11.641319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23758): Terminated: ok {rc=0} 01:24:11.691020 --- ParallelTerminationStrategy: PID 23761 died... 01:24:11.712536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23761): Terminated: ok {rc=0} 01:24:11.762434 --- ParallelTerminationStrategy: PID 23764 died... 01:24:11.783902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23764): Terminated: ok {rc=0} 01:24:11.879227 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 01:24:13.036362 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:13.050911 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:24:13.108634 tst iperf3m4.py: using LAC 37573 01:24:13.239015 tst iperf3m4.py: using RAC 88 01:24:13.368201 tst iperf3m4.py: using CellId 37573 01:24:13.497812 tst iperf3m4.py: using BVCI 37574 01:24:13.620568 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:13.633457 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:13.647044 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:13.659747 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:13.673783 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:13.687101 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:13.702058 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:13.715966 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:13.730964 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:24:13.858031 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:24:13.985041 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:24:14.111430 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:24:14.237346 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:24:14.462431 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:24:14.796744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23766): Launched 01:24:15.096125 run iperf3-srv_10.42.42.10(pid=23767): Launched 01:24:15.234094 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:24:15.458967 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:24:15.794010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23768): Launched 01:24:16.117125 run iperf3-srv_10.42.42.10(pid=23769): Launched 01:24:16.294444 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:24:16.541049 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:24:16.896924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23770): Launched 01:24:17.177629 run iperf3-srv_10.42.42.10(pid=23771): Launched 01:24:17.306603 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:24:17.511001 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:24:17.832458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23772): Launched 01:24:18.172669 run iperf3-srv_10.42.42.10(pid=23773): Launched 01:24:18.325995 tst iperf3m4.py:8: start network... 01:24:18.554928 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:24:19.075049 run create_hlr_db(pid=23774): Launched 01:24:19.240912 bus /gobi_6: Setting Powered False 01:24:20.306744 run create_hlr_db(pid=23774): Terminated: ok {rc=0} 01:24:20.771922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23776): Launched 01:24:21.115860 run osmo-hlr_10.42.42.2(pid=23777): Launched 01:24:21.364703 run osmo-stp_10.42.42.5: Starting osmo-stp 01:24:22.038125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23779): Launched 01:24:22.383826 run osmo-stp_10.42.42.5(pid=23780): Launched 01:24:22.631751 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:24:23.284127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23782): Launched 01:24:23.422276 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:24:23.705494 run patchelf(pid=23783): Launched 01:24:23.904812 run osmo-stp_10.42.42.5(pid=23780): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23780)] 01:24:24.047453 run osmo-stp_10.42.42.5(pid=23780): stdout: | (launched: 2022-12-14_01:24:22.323387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:24.190252 run osmo-stp_10.42.42.5(pid=23780): stderr: | [0;m[38;5;43m20221214012422617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012422617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012422617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012422618 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012422618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012422618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012422618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:24.336522 run osmo-stp_10.42.42.5(pid=23780): stdout: | (launched: 2022-12-14_01:24:22.323387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:24.474322 run osmo-stp_10.42.42.5(pid=23780): stderr: | [0;m[38;5;43m20221214012422617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012422617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012422617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012422618 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012422618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012422618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012422618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:24.636343 run patchelf(pid=23783): Terminating (SIGINT) 01:24:24.824886 run patchelf(pid=23783): Terminated: ok {rc=0} 01:24:24.961363 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23780): Process ended prematurely: osmo-stp_10.42.42.5(pid=23780) [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23780)] [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 01:24:24.972774 tst iperf3m4.py:8: Test FAILED (12.0 sec) 01:24:25.003154 run osmo-hlr_10.42.42.2(pid=23777): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23777)] 01:24:25.059018 run osmo-hlr_10.42.42.2(pid=23777): stdout: | (launched: 2022-12-14_01:24:21.055774) 01:24:25.113602 run osmo-hlr_10.42.42.2(pid=23777): stderr: | [0;m[1;31m20221214012421360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012421360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012421360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012421360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012421360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012421360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012421382 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012421394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012421395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012421395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:24:25.168526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23766): Terminating (SIGTERM) 01:24:25.212762 run iperf3-srv_10.42.42.10(pid=23767): Terminating (SIGTERM) 01:24:25.260897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23768): Terminating (SIGTERM) 01:24:25.305976 run iperf3-srv_10.42.42.10(pid=23769): Terminating (SIGTERM) 01:24:25.353496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23770): Terminating (SIGTERM) 01:24:25.398287 run iperf3-srv_10.42.42.10(pid=23771): Terminating (SIGTERM) 01:24:25.445613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23772): Terminating (SIGTERM) 01:24:25.490366 run iperf3-srv_10.42.42.10(pid=23773): Terminating (SIGTERM) 01:24:25.537571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23776): Terminating (SIGTERM) 01:24:25.583069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23779): Terminating (SIGTERM) 01:24:25.629222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23782): Terminating (SIGTERM) 01:24:25.676766 --- ParallelTerminationStrategy: PID 23766 died... 01:24:25.698979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23766): Terminated: ok {rc=0} 01:24:25.751858 --- ParallelTerminationStrategy: PID 23767 died... 01:24:25.772333 run iperf3-srv_10.42.42.10(pid=23767): Terminated {rc=256} 01:24:25.820893 --- ParallelTerminationStrategy: PID 23768 died... 01:24:25.843950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23768): Terminated: ok {rc=0} 01:24:25.892928 --- ParallelTerminationStrategy: PID 23769 died... 01:24:25.914460 run iperf3-srv_10.42.42.10(pid=23769): Terminated {rc=256} 01:24:25.962686 --- ParallelTerminationStrategy: PID 23770 died... 01:24:25.984325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23770): Terminated: ok {rc=0} 01:24:26.032573 --- ParallelTerminationStrategy: PID 23771 died... 01:24:26.055362 run iperf3-srv_10.42.42.10(pid=23771): Terminated {rc=256} 01:24:26.104025 --- ParallelTerminationStrategy: PID 23772 died... 01:24:26.130478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23772): Terminated: ok {rc=0} 01:24:26.177472 --- ParallelTerminationStrategy: PID 23773 died... 01:24:26.198034 run iperf3-srv_10.42.42.10(pid=23773): Terminated {rc=256} 01:24:26.244608 --- ParallelTerminationStrategy: PID 23776 died... 01:24:26.265503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23776): Terminated: ok {rc=0} 01:24:26.312148 --- ParallelTerminationStrategy: PID 23779 died... 01:24:26.332630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23779): Terminated: ok {rc=0} 01:24:26.379402 --- ParallelTerminationStrategy: PID 23782 died... 01:24:26.402479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23782): Terminated: ok {rc=0} 01:24:26.491033 bus /gobi_4: Setting Powered False 01:24:27.589456 bus /gobi_4: Setting Powered False 01:24:28.703108 bus /gobi_1: Setting Powered False 01:24:29.801066 bus /gobi_1: Setting Powered False 01:24:30.925094 bus /gobi_0: Setting Powered False 01:24:32.025285 bus /gobi_0: Setting Powered False 01:24:33.142616 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 01:24:34.248045 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:34.260582 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:24:34.314903 tst ping.py: using LAC 37574 01:24:34.440418 tst ping.py: using RAC 89 01:24:34.566503 tst ping.py: using CellId 37574 01:24:34.690381 tst ping.py: using BVCI 37575 01:24:34.805548 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:34.817396 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:34.828931 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:34.840597 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:34.852522 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:34.864467 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:34.876149 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:34.888095 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:24:35.003675 tst ping.py:19: start network... 01:24:35.200677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:24:35.656606 run create_hlr_db(pid=23785): Launched 01:24:35.778160 bus /gobi_6: Setting Powered False 01:24:36.841215 run create_hlr_db(pid=23785): Terminated: ok {rc=0} 01:24:37.266348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23787): Launched 01:24:37.561714 run osmo-hlr_10.42.42.2(pid=23788): Launched 01:24:37.674509 run osmo-stp_10.42.42.5: Starting osmo-stp 01:24:38.203243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23790): Launched 01:24:38.502601 run osmo-stp_10.42.42.5(pid=23791): Launched 01:24:38.617575 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:24:39.129647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23793): Launched 01:24:39.243794 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:24:39.495908 run patchelf(pid=23794): Launched 01:24:39.662798 run osmo-stp_10.42.42.5(pid=23791): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23791)] 01:24:39.788609 run osmo-stp_10.42.42.5(pid=23791): stdout: | (launched: 2022-12-14_01:24:38.446913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:39.916526 run osmo-stp_10.42.42.5(pid=23791): stderr: | [0;m[38;5;43m20221214012438617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012438617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012438617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012438618 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012438618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012438618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012438618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:40.045142 run osmo-stp_10.42.42.5(pid=23791): stdout: | (launched: 2022-12-14_01:24:38.446913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:40.166794 run osmo-stp_10.42.42.5(pid=23791): stderr: | [0;m[38;5;43m20221214012438617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012438617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012438617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012438618 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012438618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012438618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012438618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:40.310694 run patchelf(pid=23794): Terminating (SIGINT) 01:24:40.476847 run patchelf(pid=23794): Terminated: ok {rc=0} 01:24:40.596360 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23791): Process ended prematurely: osmo-stp_10.42.42.5(pid=23791) [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23791)] [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 01:24:40.605507 tst ping.py:22: Test FAILED (6.4 sec) 01:24:40.631958 run osmo-hlr_10.42.42.2(pid=23788): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23788)] 01:24:40.678904 run osmo-hlr_10.42.42.2(pid=23788): stdout: | (launched: 2022-12-14_01:24:37.506399) 01:24:40.727285 run osmo-hlr_10.42.42.2(pid=23788): stderr: | [0;m[1;31m20221214012437682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012437682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012437682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012437682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012437682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012437682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012437694 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012437703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012437703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012437703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:24:40.776841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23787): Terminating (SIGTERM) 01:24:40.816048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23790): Terminating (SIGTERM) 01:24:40.855231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23793): Terminating (SIGTERM) 01:24:40.894575 --- ParallelTerminationStrategy: PID 23787 died... 01:24:40.913449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23787): Terminated: ok {rc=0} 01:24:40.956891 --- ParallelTerminationStrategy: PID 23790 died... 01:24:40.975466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23790): Terminated: ok {rc=0} 01:24:41.018969 --- ParallelTerminationStrategy: PID 23793 died... 01:24:41.037665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23793): Terminated: ok {rc=0} 01:24:41.121071 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 01:24:42.208440 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:42.221744 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:24:42.278440 tst ping_idle_ping.py: using LAC 37575 01:24:42.404782 tst ping_idle_ping.py: using RAC 90 01:24:42.530281 tst ping_idle_ping.py: using CellId 37575 01:24:42.654797 tst ping_idle_ping.py: using BVCI 37576 01:24:42.771639 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:42.783725 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:42.795383 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:42.807686 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:42.819747 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:42.831883 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:42.844053 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:24:42.856089 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:24:42.972566 tst ping_idle_ping.py:24: start network... 01:24:43.171747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:24:43.634036 run create_hlr_db(pid=23795): Launched 01:24:43.759352 bus /gobi_6: Setting Powered False 01:24:44.818886 run create_hlr_db(pid=23795): Terminated: ok {rc=0} 01:24:45.256151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23797): Launched 01:24:45.576687 run osmo-hlr_10.42.42.2(pid=23798): Launched 01:24:45.701550 run osmo-stp_10.42.42.5: Starting osmo-stp 01:24:46.288528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23800): Launched 01:24:46.622047 run osmo-stp_10.42.42.5(pid=23801): Launched 01:24:46.865447 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:24:47.502437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23803): Launched 01:24:47.625909 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:24:47.894987 run patchelf(pid=23804): Launched 01:24:48.071759 run osmo-stp_10.42.42.5(pid=23801): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23801)] 01:24:48.206670 run osmo-stp_10.42.42.5(pid=23801): stdout: | (launched: 2022-12-14_01:24:46.562554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:48.343510 run osmo-stp_10.42.42.5(pid=23801): stderr: | [0;m[38;5;43m20221214012446858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012446858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012446858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012446859 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012446859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012446859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012446860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:48.480448 run osmo-stp_10.42.42.5(pid=23801): stdout: | (launched: 2022-12-14_01:24:46.562554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:48.610905 run osmo-stp_10.42.42.5(pid=23801): stderr: | [0;m[38;5;43m20221214012446858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012446858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012446858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012446859 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012446859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012446859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012446860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:48.765177 run patchelf(pid=23804): Terminating (SIGINT) 01:24:48.942515 run patchelf(pid=23804): Terminated: ok {rc=0} 01:24:49.070352 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23801): Process ended prematurely: osmo-stp_10.42.42.5(pid=23801) [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23801)] [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 01:24:49.080040 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 01:24:49.108129 run osmo-hlr_10.42.42.2(pid=23798): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23798)] 01:24:49.158944 run osmo-hlr_10.42.42.2(pid=23798): stdout: | (launched: 2022-12-14_01:24:45.517594) 01:24:49.211071 run osmo-hlr_10.42.42.2(pid=23798): stderr: | [0;m[1;31m20221214012445715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012445715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012445715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012445715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012445715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012445715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012445730 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012445739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012445740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012445740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:24:49.263430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23797): Terminating (SIGTERM) 01:24:49.305261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23800): Terminating (SIGTERM) 01:24:49.347583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23803): Terminating (SIGTERM) 01:24:49.390044 --- ParallelTerminationStrategy: PID 23797 died... 01:24:49.410520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23797): Terminated: ok {rc=0} 01:24:49.456806 --- ParallelTerminationStrategy: PID 23800 died... 01:24:49.476658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23800): Terminated: ok {rc=0} 01:24:49.522692 --- ParallelTerminationStrategy: PID 23803 died... 01:24:49.542673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23803): Terminated: ok {rc=0} 01:24:49.630933 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:24:50.942621 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:24:50.950105 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:24:50.984773 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:24:51.020897 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:24:51.076357 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:24:51.109813 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:24:51.146099 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:24:51.710046 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2397 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:24:51.715579 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:24:51.727360 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:24:51.799778 tst switch_tch_pdch.py: using LAC 37576 01:24:51.925530 tst switch_tch_pdch.py: using RAC 91 01:24:52.052791 tst switch_tch_pdch.py: using CellId 37576 01:24:52.177389 tst switch_tch_pdch.py: using BVCI 37577 01:24:52.294319 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:24:52.306035 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:24:52.317494 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:24:52.329134 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:24:52.340849 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:24:52.352738 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:24:52.364818 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:24:52.376621 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:24:52.491988 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:24:52.610947 tst switch_tch_pdch.py:51: start network... 01:24:52.823861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:24:53.314926 run create_hlr_db(pid=23810): Launched 01:24:53.436690 bus /gobi_6: Setting Powered False 01:24:54.500076 run create_hlr_db(pid=23810): Terminated: ok {rc=0} 01:24:54.944333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23812): Launched 01:24:55.262897 run osmo-hlr_10.42.42.2(pid=23813): Launched 01:24:55.386552 run osmo-stp_10.42.42.5: Starting osmo-stp 01:24:55.932200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23815): Launched 01:24:56.251391 run osmo-stp_10.42.42.5(pid=23816): Launched 01:24:56.374077 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:24:56.924336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23818): Launched 01:24:57.047541 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:24:57.316268 run patchelf(pid=23819): Launched 01:24:57.493951 run osmo-stp_10.42.42.5(pid=23816): ERR: Terminated: ERROR {rc=1} [trial-2397↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23816)] 01:24:57.628080 run osmo-stp_10.42.42.5(pid=23816): stdout: | (launched: 2022-12-14_01:24:56.192201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:57.764120 run osmo-stp_10.42.42.5(pid=23816): stderr: | [0;m[38;5;43m20221214012456383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012456383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012456383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012456383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012456384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012456384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012456384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:57.900583 run osmo-stp_10.42.42.5(pid=23816): stdout: | (launched: 2022-12-14_01:24:56.192201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:24:58.030670 run osmo-stp_10.42.42.5(pid=23816): stderr: | [0;m[38;5;43m20221214012456383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012456383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012456383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012456383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012456384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012456384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012456384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:24:58.184733 run patchelf(pid=23819): Terminating (SIGINT) 01:24:58.362254 run patchelf(pid=23819): Terminated: ok {rc=0} 01:24:58.489836 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23816): Process ended prematurely: osmo-stp_10.42.42.5(pid=23816) [trial-2397↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23816)] [trial-2397↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:24:58.499542 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 01:24:58.527435 run osmo-hlr_10.42.42.2(pid=23813): ERR: Terminated: ERROR {rc=237} [trial-2397↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23813)] 01:24:58.578209 run osmo-hlr_10.42.42.2(pid=23813): stdout: | (launched: 2022-12-14_01:24:55.203564) 01:24:58.629990 run osmo-hlr_10.42.42.2(pid=23813): stderr: | [0;m[1;31m20221214012455401 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012455401 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012455401 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012455401 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012455401 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012455401 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012455414 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012455422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012455422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012455422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:24:58.682391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23812): Terminating (SIGTERM) 01:24:58.723814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23815): Terminating (SIGTERM) 01:24:58.766234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23818): Terminating (SIGTERM) 01:24:58.808317 --- ParallelTerminationStrategy: PID 23812 died... 01:24:58.828514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23812): Terminated: ok {rc=0} 01:24:58.874776 --- ParallelTerminationStrategy: PID 23815 died... 01:24:58.894464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23815): Terminated: ok {rc=0} 01:24:58.940408 --- ParallelTerminationStrategy: PID 23818 died... 01:24:58.960092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23818): Terminated: ok {rc=0} 01:24:59.048290 bus /gobi_0: Setting Powered False 01:25:00.144771 bus /gobi_0: Setting Powered False 01:25:01.260423 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 01:25:02.512275 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:25:02.518078 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 01:25:02.550075 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 01:25:02.584223 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 01:25:02.637368 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 01:25:02.669935 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 01:25:02.703775 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 01:25:03.263139 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2397 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 01:25:03.269132 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:25:03.280656 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 01:25:03.355548 tst switch_tch_pdch.py: using LAC 37577 01:25:03.478954 tst switch_tch_pdch.py: using RAC 92 01:25:03.600601 tst switch_tch_pdch.py: using CellId 37577 01:25:03.722369 tst switch_tch_pdch.py: using BVCI 37578 01:25:03.836686 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:25:03.848187 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:25:03.859377 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:25:03.870641 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:25:03.882212 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:25:03.893840 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:25:03.905528 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:25:03.917194 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:25:04.032729 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:25:04.153140 tst switch_tch_pdch.py:51: start network... 01:25:04.366646 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:25:04.828262 run create_hlr_db(pid=23827): Launched 01:25:04.949747 bus /gobi_6: Setting Powered False 01:25:06.012271 run create_hlr_db(pid=23827): Terminated: ok {rc=0} 01:25:06.428590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23829): Launched 01:25:06.746833 run osmo-hlr_10.42.42.2(pid=23830): Launched 01:25:06.868442 run osmo-stp_10.42.42.5: Starting osmo-stp 01:25:07.390469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23832): Launched 01:25:07.709910 run osmo-stp_10.42.42.5(pid=23833): Launched 01:25:07.832274 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:25:08.353619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23835): Launched 01:25:08.477230 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:25:08.746649 run patchelf(pid=23836): Launched 01:25:08.923750 run osmo-stp_10.42.42.5(pid=23833): ERR: Terminated: ERROR {rc=1} [trial-2397↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23833)] 01:25:09.058002 run osmo-stp_10.42.42.5(pid=23833): stdout: | (launched: 2022-12-14_01:25:07.650953) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:09.193831 run osmo-stp_10.42.42.5(pid=23833): stderr: | [0;m[38;5;43m20221214012507845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012507845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012507846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012507846 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012507848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012507848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012507848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:09.330723 run osmo-stp_10.42.42.5(pid=23833): stdout: | (launched: 2022-12-14_01:25:07.650953) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:09.460262 run osmo-stp_10.42.42.5(pid=23833): stderr: | [0;m[38;5;43m20221214012507845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012507845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012507846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012507846 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012507848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012507848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012507848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:09.614357 run patchelf(pid=23836): Terminating (SIGINT) 01:25:09.790860 run patchelf(pid=23836): Terminated: ok {rc=0} 01:25:09.918152 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23833): Process ended prematurely: osmo-stp_10.42.42.5(pid=23833) [trial-2397↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23833)] [trial-2397↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 01:25:09.927861 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 01:25:09.955663 run osmo-hlr_10.42.42.2(pid=23830): ERR: Terminated: ERROR {rc=237} [trial-2397↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23830)] 01:25:10.005836 run osmo-hlr_10.42.42.2(pid=23830): stdout: | (launched: 2022-12-14_01:25:06.687377) 01:25:10.057749 run osmo-hlr_10.42.42.2(pid=23830): stderr: | [0;m[1;31m20221214012506886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012506886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012506886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012506886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012506886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012506886 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012506899 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012506907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012506907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012506907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:25:10.109932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23829): Terminating (SIGTERM) 01:25:10.151375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23832): Terminating (SIGTERM) 01:25:10.193725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23835): Terminating (SIGTERM) 01:25:10.236339 --- ParallelTerminationStrategy: PID 23829 died... 01:25:10.256666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23829): Terminated: ok {rc=0} 01:25:10.302635 --- ParallelTerminationStrategy: PID 23832 died... 01:25:10.322384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23832): Terminated: ok {rc=0} 01:25:10.368059 --- ParallelTerminationStrategy: PID 23835 died... 01:25:10.387717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23835): Terminated: ok {rc=0} 01:25:10.474417 bus /gobi_0: Setting Powered False 01:25:11.571965 bus /gobi_0: Setting Powered False 01:25:12.688005 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 nitb_sms:trx-lms --------------------------------------------------------------------- 01:25:13.942608 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:25:13.946943 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 01:25:13.980876 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 01:25:13.989648 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 01:25:14.043714 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 01:25:14.077492 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 01:25:14.084451 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 01:25:14.619607 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 01:25:14.624792 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 01:25:14.635642 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 01:25:14.683251 tst mo_mt_sms.py: using LAC 37578 01:25:14.802011 tst mo_mt_sms.py: using RAC 93 01:25:14.916777 tst mo_mt_sms.py: using CellId 37578 01:25:15.031120 tst mo_mt_sms.py: using BVCI 37579 01:25:15.137673 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 01:25:15.256431 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 01:25:15.369434 tst mo_mt_sms.py:9: start nitb and bts... 01:25:15.568991 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:25:16.214968 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23840): Launched 01:25:16.537687 run osmo-nitb_10.42.42.2(pid=23841): Launched 01:25:16.726951 run osmo-nitb_10.42.42.2(pid=23841): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23841)] 01:25:16.874431 run osmo-nitb_10.42.42.2(pid=23841): stdout: | (launched: 2022-12-14_01:25:16.474741) 01:25:17.022367 run osmo-nitb_10.42.42.2(pid=23841): stderr: | (launched: 2022-12-14_01:25:16.520168) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:25:17.171465 run osmo-nitb_10.42.42.2(pid=23841): stdout: | (launched: 2022-12-14_01:25:16.474741) 01:25:17.311125 run osmo-nitb_10.42.42.2(pid=23841): stderr: | (launched: 2022-12-14_01:25:16.520168) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8b7301f268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23841): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23841) [trial-2397↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23841)] 01:25:17.669991 tst osmo-nitb_10.42.42.2(pid=23841): stdout: | (launched: 2022-12-14_01:25:16.474741) 01:25:17.799116 tst osmo-nitb_10.42.42.2(pid=23841): stderr: | (launched: 2022-12-14_01:25:16.520168) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:25:17.950315 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=23841): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23841) [trial-2397↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23841)] [trial-2397↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 01:25:17.959545 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 01:25:17.966839 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23840): Terminating (SIGTERM) 01:25:18.178800 --- ParallelTerminationStrategy: PID 23840 died... 01:25:18.200522 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23840): Terminated: ok {rc=0} 01:25:18.290681 bus /sierra_3: Setting Powered False 01:25:19.387219 bus /sierra_3: Setting Powered False 01:25:20.502883 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 sms:trx-lms --------------------------------------------------------------------- 01:25:21.701275 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:25:21.705616 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 01:25:21.738165 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 01:25:21.764407 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 01:25:21.819157 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 01:25:21.851809 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 01:25:21.877845 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 01:25:22.421640 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 01:25:22.426709 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:22.437441 tst sms:trx-lms: Using 1 x bts (candidates: 1) 01:25:22.484880 tst mo_mt_sms.py: using LAC 37579 01:25:22.601317 tst mo_mt_sms.py: using RAC 94 01:25:22.717215 tst mo_mt_sms.py: using CellId 37579 01:25:22.832882 tst mo_mt_sms.py: using BVCI 37580 01:25:22.939978 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:22.950550 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:22.960872 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:22.971189 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:22.981535 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:22.991863 tst sms:trx-lms: Using 1 x modem (candidates: 2) 01:25:23.110599 tst sms:trx-lms: Using 1 x modem (candidates: 2) 01:25:23.232844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:25:23.724377 run create_hlr_db(pid=23845): Launched 01:25:23.847139 bus /sierra_2: Setting Powered False 01:25:24.909949 run create_hlr_db(pid=23845): Terminated: ok {rc=0} 01:25:25.335872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23847): Launched 01:25:25.633643 run osmo-hlr_10.42.42.2(pid=23848): Launched 01:25:25.749214 run osmo-stp_10.42.42.5: Starting osmo-stp 01:25:26.266191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23850): Launched 01:25:26.562320 run osmo-stp_10.42.42.5(pid=23851): Launched 01:25:26.677149 run osmo-msc_10.42.42.6: Starting osmo-msc 01:25:27.212626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23853): Launched 01:25:27.510582 run osmo-msc_10.42.42.6(pid=23854): Launched 01:25:27.676594 run osmo-stp_10.42.42.5(pid=23851): ERR: Terminated: ERROR {rc=1} [trial-2397↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23851)] 01:25:27.800854 run osmo-stp_10.42.42.5(pid=23851): stdout: | (launched: 2022-12-14_01:25:26.506754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:27.926479 run osmo-stp_10.42.42.5(pid=23851): stderr: | [0;m[38;5;43m20221214012526676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012526676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012526677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012526677 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012526678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012526678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012526678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:28.054205 run osmo-stp_10.42.42.5(pid=23851): stdout: | (launched: 2022-12-14_01:25:26.506754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:28.171490 run osmo-stp_10.42.42.5(pid=23851): stderr: | [0;m[38;5;43m20221214012526676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012526676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012526677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012526677 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012526678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012526678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012526678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:28.312204 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=23851): Process ended prematurely: osmo-stp_10.42.42.5(pid=23851) [trial-2397↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23851)] [trial-2397↪sms:trx-lms↪mo_mt_sms.py:16] 01:25:28.320518 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 01:25:28.345930 run osmo-hlr_10.42.42.2(pid=23848): ERR: Terminated: ERROR {rc=237} [trial-2397↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23848)] 01:25:28.393437 run osmo-hlr_10.42.42.2(pid=23848): stdout: | (launched: 2022-12-14_01:25:25.578252) 01:25:28.441863 run osmo-hlr_10.42.42.2(pid=23848): stderr: | [0;m[1;31m20221214012525755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012525755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012525755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012525755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012525755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012525755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012525767 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012525776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012525776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012525776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:25:28.509610 run osmo-msc_10.42.42.6(pid=23854): ERR: Terminated: ERROR {rc=2} [trial-2397↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23854)] 01:25:28.556220 run osmo-msc_10.42.42.6(pid=23854): stdout: | (launched: 2022-12-14_01:25:27.454671) 01:25:28.604503 run osmo-msc_10.42.42.6(pid=23854): stderr: | [0;m[38;5;43m20221214012527726 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214012527726 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f58552c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214012527727 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214012527727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214012527727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214012527727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214012527729 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214012527729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214012527729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214012527729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:25:28.653298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23847): Terminating (SIGTERM) 01:25:28.692387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23850): Terminating (SIGTERM) 01:25:28.731353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23853): Terminating (SIGTERM) 01:25:28.770459 --- ParallelTerminationStrategy: PID 23847 died... 01:25:28.789383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23847): Terminated: ok {rc=0} 01:25:28.832656 --- ParallelTerminationStrategy: PID 23850 died... 01:25:28.851006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23850): Terminated: ok {rc=0} 01:25:28.893850 --- ParallelTerminationStrategy: PID 23853 died... 01:25:28.912099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23853): Terminated: ok {rc=0} 01:25:28.994450 bus /sierra_3: Setting Powered False 01:25:30.088479 bus /sierra_3: Setting Powered False 01:25:31.210278 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 nitb_ussd:trx-lms --------------------------------------------------------------------- 01:25:32.450445 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:25:32.455473 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 01:25:32.490044 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 01:25:32.498338 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 01:25:32.535608 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 01:25:32.568646 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 01:25:32.575535 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 01:25:33.092555 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2397 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 01:25:33.097826 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 01:25:33.108460 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 01:25:33.158475 tst assert_extension.py: using LAC 37580 01:25:33.274785 tst assert_extension.py: using RAC 95 01:25:33.389346 tst assert_extension.py: using CellId 37580 01:25:33.504169 tst assert_extension.py: using BVCI 37581 01:25:33.611357 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 01:25:33.730400 tst assert_extension.py:10: start nitb and bts... 01:25:33.944399 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:25:34.592846 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23859): Launched 01:25:34.912165 run osmo-nitb_10.42.42.2(pid=23860): Launched 01:25:35.087277 run osmo-nitb_10.42.42.2(pid=23860): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23860)] 01:25:35.228917 run osmo-nitb_10.42.42.2(pid=23860): stdout: | (launched: 2022-12-14_01:25:34.853040) 01:25:35.373113 run osmo-nitb_10.42.42.2(pid=23860): stderr: | (launched: 2022-12-14_01:25:34.899968) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:25:35.516724 run osmo-nitb_10.42.42.2(pid=23860): stdout: | (launched: 2022-12-14_01:25:34.853040) 01:25:35.654031 run osmo-nitb_10.42.42.2(pid=23860): stderr: | (launched: 2022-12-14_01:25:34.899968) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8b7301f268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23860): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23860) [trial-2397↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23860)] 01:25:36.031216 tst osmo-nitb_10.42.42.2(pid=23860): stdout: | (launched: 2022-12-14_01:25:34.853040) 01:25:36.159492 tst osmo-nitb_10.42.42.2(pid=23860): stderr: | (launched: 2022-12-14_01:25:34.899968) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:25:36.311027 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=23860): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23860) [trial-2397↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23860)] [trial-2397↪nitb_ussd:trx-lms↪assert_extension.py:12] 01:25:36.320303 tst assert_extension.py:12: Test FAILED (3.2 sec) 01:25:36.327698 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23859): Terminating (SIGTERM) 01:25:36.538618 --- ParallelTerminationStrategy: PID 23859 died... 01:25:36.560530 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23859): Terminated: ok {rc=0} 01:25:36.650251 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 ussd:trx-lms --------------------------------------------------------------------- 01:25:37.829826 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:25:37.833964 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 01:25:37.866446 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 01:25:37.892799 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 01:25:37.927202 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 01:25:37.961208 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 01:25:37.988697 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 01:25:38.518633 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2397 ussd:trx-lms assert_extension.py ---------------------------------------------- 01:25:38.524203 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:38.535261 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 01:25:38.583593 tst assert_extension.py: using LAC 37581 01:25:38.706848 tst assert_extension.py: using RAC 96 01:25:38.830426 tst assert_extension.py: using CellId 37581 01:25:38.952329 tst assert_extension.py: using BVCI 37582 01:25:39.067103 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:39.078270 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:39.089240 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:39.100028 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:39.111242 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 01:25:39.122395 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 01:25:39.237766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:25:39.695957 run create_hlr_db(pid=23864): Launched 01:25:39.817753 bus /sierra_2: Setting Powered False 01:25:40.877055 run create_hlr_db(pid=23864): Terminated: ok {rc=0} 01:25:41.312812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23866): Launched 01:25:41.632468 run osmo-hlr_10.42.42.2(pid=23867): Launched 01:25:41.754858 run osmo-stp_10.42.42.5: Starting osmo-stp 01:25:42.307293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23869): Launched 01:25:42.627229 run osmo-stp_10.42.42.5(pid=23870): Launched 01:25:42.750550 run osmo-msc_10.42.42.6: Starting osmo-msc 01:25:43.326167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23872): Launched 01:25:43.644023 run osmo-msc_10.42.42.6(pid=23873): Launched 01:25:43.824227 run osmo-stp_10.42.42.5(pid=23870): ERR: Terminated: ERROR {rc=1} [trial-2397↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23870)] 01:25:43.959222 run osmo-stp_10.42.42.5(pid=23870): stdout: | (launched: 2022-12-14_01:25:42.568094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:44.093570 run osmo-stp_10.42.42.5(pid=23870): stderr: | [0;m[38;5;43m20221214012542758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012542758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012542759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012542759 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012542760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012542760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012542760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:44.227214 run osmo-stp_10.42.42.5(pid=23870): stdout: | (launched: 2022-12-14_01:25:42.568094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:44.354842 run osmo-stp_10.42.42.5(pid=23870): stderr: | [0;m[38;5;43m20221214012542758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012542758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012542759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012542759 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012542760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012542760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012542760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:44.506629 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=23870): Process ended prematurely: osmo-stp_10.42.42.5(pid=23870) [trial-2397↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23870)] [trial-2397↪ussd:trx-lms↪assert_extension.py:17] 01:25:44.515778 tst assert_extension.py:17: Test FAILED (6.0 sec) 01:25:44.543097 run osmo-hlr_10.42.42.2(pid=23867): ERR: Terminated: ERROR {rc=237} [trial-2397↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23867)] 01:25:44.593386 run osmo-hlr_10.42.42.2(pid=23867): stdout: | (launched: 2022-12-14_01:25:41.573575) 01:25:44.645334 run osmo-hlr_10.42.42.2(pid=23867): stderr: | [0;m[1;31m20221214012541770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012541770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012541770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012541770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012541770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012541770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012541782 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012541790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012541790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012541790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:25:44.717075 run osmo-msc_10.42.42.6(pid=23873): ERR: Terminated: ERROR {rc=2} [trial-2397↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23873)] 01:25:44.766502 run osmo-msc_10.42.42.6(pid=23873): stdout: | (launched: 2022-12-14_01:25:43.585114) 01:25:44.817854 run osmo-msc_10.42.42.6(pid=23873): stderr: | [0;m[38;5;43m20221214012543907 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214012543907 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f51c4a54c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214012543907 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214012543907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214012543907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214012543907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214012543909 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214012543910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214012543910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214012543910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:25:44.870099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23866): Terminating (SIGTERM) 01:25:44.911738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23869): Terminating (SIGTERM) 01:25:44.953921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23872): Terminating (SIGTERM) 01:25:44.996638 --- ParallelTerminationStrategy: PID 23866 died... 01:25:45.017437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23866): Terminated: ok {rc=0} 01:25:45.063944 --- ParallelTerminationStrategy: PID 23869 died... 01:25:45.083931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23869): Terminated: ok {rc=0} 01:25:45.131092 --- ParallelTerminationStrategy: PID 23872 died... 01:25:45.151059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23872): Terminated: ok {rc=0} 01:25:45.239341 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 01:25:46.484361 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:25:46.495619 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 01:25:46.542873 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 01:25:46.578127 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 01:25:46.643997 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 01:25:46.710273 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 01:25:46.741549 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 01:25:47.256686 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 01:25:47.312655 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:47.324507 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:25:47.400822 tst mo_mt_call.py: using LAC 37582 01:25:47.527256 tst mo_mt_call.py: using RAC 97 01:25:47.652169 tst mo_mt_call.py: using CellId 37582 01:25:47.782978 tst mo_mt_call.py: using BVCI 37583 01:25:47.902399 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:47.914209 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:47.925572 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:47.936932 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:47.949272 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:47.961466 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:25:48.080447 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:25:48.201537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:25:48.702336 run create_hlr_db(pid=23878): Launched 01:25:48.826951 bus /sierra_2: Setting Powered False 01:25:49.890566 run create_hlr_db(pid=23878): Terminated: ok {rc=0} 01:25:50.342055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23880): Launched 01:25:50.665688 run osmo-hlr_10.42.42.2(pid=23881): Launched 01:25:50.791290 run osmo-stp_10.42.42.5: Starting osmo-stp 01:25:51.347787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23883): Launched 01:25:51.673701 run osmo-stp_10.42.42.5(pid=23884): Launched 01:25:51.798457 run osmo-msc_10.42.42.6: Starting osmo-msc 01:25:52.381168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23887): Launched 01:25:52.684032 run osmo-msc_10.42.42.6(pid=23888): Launched 01:25:52.850568 run osmo-stp_10.42.42.5(pid=23884): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23884)] 01:25:52.977670 run osmo-stp_10.42.42.5(pid=23884): stdout: | (launched: 2022-12-14_01:25:51.613974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:53.104522 run osmo-stp_10.42.42.5(pid=23884): stderr: | [0;m[38;5;43m20221214012551806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012551807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012551807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012551807 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012551808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012551808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012551808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:53.229957 run osmo-stp_10.42.42.5(pid=23884): stdout: | (launched: 2022-12-14_01:25:51.613974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:25:53.349319 run osmo-stp_10.42.42.5(pid=23884): stderr: | [0;m[38;5;43m20221214012551806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012551807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012551807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012551807 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012551808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012551808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012551808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:25:53.492345 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23884): Process ended prematurely: osmo-stp_10.42.42.5(pid=23884) [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23884)] [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 01:25:53.501538 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 01:25:53.527969 run osmo-hlr_10.42.42.2(pid=23881): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23881)] 01:25:53.575225 run osmo-hlr_10.42.42.2(pid=23881): stdout: | (launched: 2022-12-14_01:25:50.605986) 01:25:53.624254 run osmo-hlr_10.42.42.2(pid=23881): stderr: | [0;m[1;31m20221214012550804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012550804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012550804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012550804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012550804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012550804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012550818 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012550826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012550826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012550826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:25:53.692446 run osmo-msc_10.42.42.6(pid=23888): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23888)] 01:25:53.739570 run osmo-msc_10.42.42.6(pid=23888): stdout: | (launched: 2022-12-14_01:25:52.627526) 01:25:53.788443 run osmo-msc_10.42.42.6(pid=23888): stderr: | [0;m[38;5;43m20221214012552901 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214012552901 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f74fc9dec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214012552901 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214012552901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214012552902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214012552902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214012552903 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214012552904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214012552904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214012552904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:25:53.837673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23880): Terminating (SIGTERM) 01:25:53.876929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23883): Terminating (SIGTERM) 01:25:53.916152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23887): Terminating (SIGTERM) 01:25:53.955760 --- ParallelTerminationStrategy: PID 23880 died... 01:25:53.974845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23880): Terminated: ok {rc=0} 01:25:54.018424 --- ParallelTerminationStrategy: PID 23883 died... 01:25:54.036880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23883): Terminated: ok {rc=0} 01:25:54.080744 --- ParallelTerminationStrategy: PID 23887 died... 01:25:54.099594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23887): Terminated: ok {rc=0} 01:25:54.185598 bus /sierra_3: Setting Powered False 01:25:55.284481 bus /sierra_3: Setting Powered False 01:25:56.400530 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 01:25:57.552366 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:57.564842 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:25:57.637933 tst mo_mt_call_osmux.py: using LAC 37583 01:25:57.763287 tst mo_mt_call_osmux.py: using RAC 98 01:25:57.888873 tst mo_mt_call_osmux.py: using CellId 37583 01:25:58.014260 tst mo_mt_call_osmux.py: using BVCI 37584 01:25:58.131238 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:58.142840 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:58.154378 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:58.165877 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:58.177740 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:25:58.189455 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:25:58.305823 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:25:58.424396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:25:58.894420 run create_hlr_db(pid=23890): Launched 01:25:59.020006 bus /sierra_2: Setting Powered False 01:26:00.081208 run create_hlr_db(pid=23890): Terminated: ok {rc=0} 01:26:00.526446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23892): Launched 01:26:00.873754 run osmo-hlr_10.42.42.2(pid=23893): Launched 01:26:01.091167 run osmo-stp_10.42.42.5: Starting osmo-stp 01:26:01.758920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23895): Launched 01:26:02.103954 run osmo-stp_10.42.42.5(pid=23896): Launched 01:26:02.362083 run osmo-msc_10.42.42.6: Starting osmo-msc 01:26:02.909345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23898): Launched 01:26:03.212660 run osmo-msc_10.42.42.6(pid=23899): Launched 01:26:03.381971 run osmo-stp_10.42.42.5(pid=23896): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23896)] 01:26:03.510384 run osmo-stp_10.42.42.5(pid=23896): stdout: | (launched: 2022-12-14_01:26:02.042444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:03.638154 run osmo-stp_10.42.42.5(pid=23896): stderr: | [0;m[38;5;43m20221214012602275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012602275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012602276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012602276 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012602277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012602277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012602277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:03.763680 run osmo-stp_10.42.42.5(pid=23896): stdout: | (launched: 2022-12-14_01:26:02.042444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:03.882928 run osmo-stp_10.42.42.5(pid=23896): stderr: | [0;m[38;5;43m20221214012602275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012602275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012602276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012602276 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012602277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012602277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012602277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:04.026422 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23896): Process ended prematurely: osmo-stp_10.42.42.5(pid=23896) [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23896)] [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 01:26:04.035287 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 01:26:04.061718 run osmo-hlr_10.42.42.2(pid=23893): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23893)] 01:26:04.109322 run osmo-hlr_10.42.42.2(pid=23893): stdout: | (launched: 2022-12-14_01:26:00.792875) 01:26:04.158452 run osmo-hlr_10.42.42.2(pid=23893): stderr: | [0;m[1;31m20221214012601109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012601109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012601109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012601109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012601109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012601109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012601124 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012601134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012601134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012601134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:26:04.227119 run osmo-msc_10.42.42.6(pid=23899): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23899)] 01:26:04.274660 run osmo-msc_10.42.42.6(pid=23899): stdout: | (launched: 2022-12-14_01:26:03.155491) 01:26:04.323682 run osmo-msc_10.42.42.6(pid=23899): stderr: | [0;m[38;5;43m20221214012603430 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214012603430 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe58d253c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214012603430 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214012603430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214012603430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214012603430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214012603432 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214012603432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214012603433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214012603433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:26:04.373260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23892): Terminating (SIGTERM) 01:26:04.412720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23895): Terminating (SIGTERM) 01:26:04.452378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23898): Terminating (SIGTERM) 01:26:04.491958 --- ParallelTerminationStrategy: PID 23892 died... 01:26:04.511049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23892): Terminated: ok {rc=0} 01:26:04.554961 --- ParallelTerminationStrategy: PID 23895 died... 01:26:04.573540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23895): Terminated: ok {rc=0} 01:26:04.617043 --- ParallelTerminationStrategy: PID 23898 died... 01:26:04.635632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23898): Terminated: ok {rc=0} 01:26:04.721577 bus /sierra_3: Setting Powered False 01:26:05.823349 bus /sierra_3: Setting Powered False 01:26:06.939491 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 01:26:08.193143 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:26:08.200266 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 01:26:08.234751 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 01:26:08.263207 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 01:26:08.317644 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 01:26:08.352382 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 01:26:08.380179 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 01:26:08.930652 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 01:26:08.983868 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:08.995603 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:26:09.071050 tst mo_mt_call.py: using LAC 37584 01:26:09.197180 tst mo_mt_call.py: using RAC 99 01:26:09.321177 tst mo_mt_call.py: using CellId 37584 01:26:09.445345 tst mo_mt_call.py: using BVCI 37585 01:26:09.562329 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:09.574026 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:09.585680 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:09.597240 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:09.609200 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:09.620843 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:26:09.738359 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:26:09.854034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:26:10.322925 run create_hlr_db(pid=23904): Launched 01:26:10.448363 bus /sierra_2: Setting Powered False 01:26:11.508933 run create_hlr_db(pid=23904): Terminated: ok {rc=0} 01:26:11.951729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23906): Launched 01:26:12.279343 run osmo-hlr_10.42.42.2(pid=23907): Launched 01:26:12.405010 run osmo-stp_10.42.42.5: Starting osmo-stp 01:26:12.964718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23909): Launched 01:26:13.290492 run osmo-stp_10.42.42.5(pid=23910): Launched 01:26:13.415696 run osmo-msc_10.42.42.6: Starting osmo-msc 01:26:14.001283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23912): Launched 01:26:14.326195 run osmo-msc_10.42.42.6(pid=23913): Launched 01:26:14.507694 run osmo-stp_10.42.42.5(pid=23910): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23910)] 01:26:14.643771 run osmo-stp_10.42.42.5(pid=23910): stdout: | (launched: 2022-12-14_01:26:13.230137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:14.780723 run osmo-stp_10.42.42.5(pid=23910): stderr: | [0;m[38;5;43m20221214012613423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012613423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012613423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012613423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012613424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012613424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012613424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:14.916108 run osmo-stp_10.42.42.5(pid=23910): stdout: | (launched: 2022-12-14_01:26:13.230137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:15.044313 run osmo-stp_10.42.42.5(pid=23910): stderr: | [0;m[38;5;43m20221214012613423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012613423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012613423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012613423 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012613424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012613424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012613424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:15.197685 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23910): Process ended prematurely: osmo-stp_10.42.42.5(pid=23910) [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23910)] [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 01:26:15.207495 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:26:15.235298 run osmo-hlr_10.42.42.2(pid=23907): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23907)] 01:26:15.286018 run osmo-hlr_10.42.42.2(pid=23907): stdout: | (launched: 2022-12-14_01:26:12.219308) 01:26:15.338567 run osmo-hlr_10.42.42.2(pid=23907): stderr: | [0;m[1;31m20221214012612417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012612417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012612417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012612417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012612417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012612417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012612430 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012612438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012612438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012612438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:26:15.411000 run osmo-msc_10.42.42.6(pid=23913): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23913)] 01:26:15.460550 run osmo-msc_10.42.42.6(pid=23913): stdout: | (launched: 2022-12-14_01:26:14.265963) 01:26:15.512497 run osmo-msc_10.42.42.6(pid=23913): stderr: | [0;m[38;5;43m20221214012614587 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214012614587 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4abb39fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214012614587 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214012614587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214012614587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214012614587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214012614589 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214012614590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214012614590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214012614590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:26:15.564442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23906): Terminating (SIGTERM) 01:26:15.606321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23909): Terminating (SIGTERM) 01:26:15.648433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23912): Terminating (SIGTERM) 01:26:15.690817 --- ParallelTerminationStrategy: PID 23906 died... 01:26:15.711315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23906): Terminated: ok {rc=0} 01:26:15.757552 --- ParallelTerminationStrategy: PID 23909 died... 01:26:15.777416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23909): Terminated: ok {rc=0} 01:26:15.823651 --- ParallelTerminationStrategy: PID 23912 died... 01:26:15.853693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23912): Terminated: ok {rc=0} 01:26:15.958880 bus /sierra_3: Setting Powered False 01:26:17.056720 bus /sierra_3: Setting Powered False 01:26:18.172367 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 01:26:19.322648 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:19.334925 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:26:19.406641 tst mo_mt_call_osmux.py: using LAC 37585 01:26:19.534145 tst mo_mt_call_osmux.py: using RAC 100 01:26:19.661360 tst mo_mt_call_osmux.py: using CellId 37585 01:26:19.789106 tst mo_mt_call_osmux.py: using BVCI 37586 01:26:19.898702 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:19.910038 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:19.921156 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:19.932199 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:19.943492 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:26:19.954568 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:26:20.073784 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:26:20.190459 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:26:20.658772 run create_hlr_db(pid=23915): Launched 01:26:20.785376 bus /sierra_2: Setting Powered False 01:26:21.845533 run create_hlr_db(pid=23915): Terminated: ok {rc=0} 01:26:22.288626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23917): Launched 01:26:22.614861 run osmo-hlr_10.42.42.2(pid=23918): Launched 01:26:22.740049 run osmo-stp_10.42.42.5: Starting osmo-stp 01:26:23.298155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23920): Launched 01:26:23.622068 run osmo-stp_10.42.42.5(pid=23921): Launched 01:26:23.747033 run osmo-msc_10.42.42.6: Starting osmo-msc 01:26:24.335251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23923): Launched 01:26:24.660457 run osmo-msc_10.42.42.6(pid=23924): Launched 01:26:24.842074 run osmo-stp_10.42.42.5(pid=23921): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23921)] 01:26:24.979340 run osmo-stp_10.42.42.5(pid=23921): stdout: | (launched: 2022-12-14_01:26:23.562106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:25.116733 run osmo-stp_10.42.42.5(pid=23921): stderr: | [0;m[38;5;43m20221214012623754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012623754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012623754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012623754 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012623755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012623755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012623755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:25.253066 run osmo-stp_10.42.42.5(pid=23921): stdout: | (launched: 2022-12-14_01:26:23.562106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:25.382392 run osmo-stp_10.42.42.5(pid=23921): stderr: | [0;m[38;5;43m20221214012623754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012623754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012623754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012623754 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012623755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012623755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012623755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:25.536512 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23921): Process ended prematurely: osmo-stp_10.42.42.5(pid=23921) [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23921)] [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 01:26:25.546369 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:26:25.574445 run osmo-hlr_10.42.42.2(pid=23918): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23918)] 01:26:25.625144 run osmo-hlr_10.42.42.2(pid=23918): stdout: | (launched: 2022-12-14_01:26:22.554714) 01:26:25.677439 run osmo-hlr_10.42.42.2(pid=23918): stderr: | [0;m[1;31m20221214012622754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012622754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012622754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012622754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012622754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012622754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012622766 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012622775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012622775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012622775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:26:25.749930 run osmo-msc_10.42.42.6(pid=23924): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23924)] 01:26:25.799772 run osmo-msc_10.42.42.6(pid=23924): stdout: | (launched: 2022-12-14_01:26:24.600815) 01:26:25.852078 run osmo-msc_10.42.42.6(pid=23924): stderr: | [0;m[38;5;43m20221214012624922 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214012624922 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa5a4874c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214012624922 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214012624922 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214012624923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214012624923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214012624924 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214012624925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214012624925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214012624925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:26:25.904597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23917): Terminating (SIGTERM) 01:26:25.946523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23920): Terminating (SIGTERM) 01:26:25.988600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23923): Terminating (SIGTERM) 01:26:26.031167 --- ParallelTerminationStrategy: PID 23917 died... 01:26:26.051791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23917): Terminated: ok {rc=0} 01:26:26.098267 --- ParallelTerminationStrategy: PID 23920 died... 01:26:26.118179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23920): Terminated: ok {rc=0} 01:26:26.164106 --- ParallelTerminationStrategy: PID 23923 died... 01:26:26.184027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23923): Terminated: ok {rc=0} 01:26:26.272422 bus /sierra_3: Setting Powered False 01:26:27.369103 bus /sierra_3: Setting Powered False 01:26:28.483715 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 01:26:29.732313 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:26:29.738893 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 01:26:29.771439 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 01:26:29.798023 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 01:26:29.848718 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 01:26:29.881755 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 01:26:29.908421 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 01:26:30.459679 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 01:26:30.507976 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:30.519274 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:26:30.588572 tst mo_mt_call.py: using LAC 37586 01:26:30.708602 tst mo_mt_call.py: using RAC 101 01:26:30.832510 tst mo_mt_call.py: using CellId 37586 01:26:30.986584 tst mo_mt_call.py: using BVCI 37587 01:26:31.108638 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:31.121599 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:31.134029 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:31.146504 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:31.159911 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:31.173515 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:26:31.298235 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:26:31.442358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:26:31.968815 run create_hlr_db(pid=23929): Launched 01:26:32.111101 bus /sierra_2: Setting Powered False 01:26:33.175467 run create_hlr_db(pid=23929): Terminated: ok {rc=0} 01:26:33.612360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23931): Launched 01:26:33.916033 run osmo-hlr_10.42.42.2(pid=23932): Launched 01:26:34.030472 run osmo-stp_10.42.42.5: Starting osmo-stp 01:26:34.552382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23934): Launched 01:26:34.855461 run osmo-stp_10.42.42.5(pid=23935): Launched 01:26:34.971771 run osmo-msc_10.42.42.6: Starting osmo-msc 01:26:35.519476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23937): Launched 01:26:35.821608 run osmo-msc_10.42.42.6(pid=23938): Launched 01:26:35.990964 run osmo-stp_10.42.42.5(pid=23935): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23935)] 01:26:36.118548 run osmo-stp_10.42.42.5(pid=23935): stdout: | (launched: 2022-12-14_01:26:34.798368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:36.246363 run osmo-stp_10.42.42.5(pid=23935): stderr: | [0;m[38;5;43m20221214012634970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012634970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012634970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012634970 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012634971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012634971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012634971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:36.372173 run osmo-stp_10.42.42.5(pid=23935): stdout: | (launched: 2022-12-14_01:26:34.798368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:36.491969 run osmo-stp_10.42.42.5(pid=23935): stderr: | [0;m[38;5;43m20221214012634970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012634970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012634970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012634970 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012634971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012634971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012634971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:36.635468 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23935): Process ended prematurely: osmo-stp_10.42.42.5(pid=23935) [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23935)] [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 01:26:36.644476 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 01:26:36.670611 run osmo-hlr_10.42.42.2(pid=23932): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23932)] 01:26:36.717736 run osmo-hlr_10.42.42.2(pid=23932): stdout: | (launched: 2022-12-14_01:26:33.859465) 01:26:36.766250 run osmo-hlr_10.42.42.2(pid=23932): stderr: | [0;m[1;31m20221214012634035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012634035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012634035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012634035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012634036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012634036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012634048 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012634057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012634058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012634058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:26:36.833974 run osmo-msc_10.42.42.6(pid=23938): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23938)] 01:26:36.880847 run osmo-msc_10.42.42.6(pid=23938): stdout: | (launched: 2022-12-14_01:26:35.765137) 01:26:36.929792 run osmo-msc_10.42.42.6(pid=23938): stderr: | [0;m[38;5;43m20221214012636040 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214012636040 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbae242ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214012636040 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214012636040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214012636040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214012636041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214012636042 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214012636043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214012636043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214012636043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:26:36.978649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23931): Terminating (SIGTERM) 01:26:37.017743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23934): Terminating (SIGTERM) 01:26:37.056820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23937): Terminating (SIGTERM) 01:26:37.096055 --- ParallelTerminationStrategy: PID 23931 died... 01:26:37.115234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23931): Terminated: ok {rc=0} 01:26:37.158848 --- ParallelTerminationStrategy: PID 23934 died... 01:26:37.177325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23934): Terminated: ok {rc=0} 01:26:37.221051 --- ParallelTerminationStrategy: PID 23937 died... 01:26:37.239624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23937): Terminated: ok {rc=0} 01:26:37.325781 bus /sierra_3: Setting Powered False 01:26:38.427532 bus /sierra_3: Setting Powered False 01:26:39.547297 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 01:26:40.694039 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:40.705973 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:26:40.775107 tst mo_mt_call_osmux.py: using LAC 37587 01:26:40.893557 tst mo_mt_call_osmux.py: using RAC 102 01:26:41.022599 tst mo_mt_call_osmux.py: using CellId 37587 01:26:41.152870 tst mo_mt_call_osmux.py: using BVCI 37588 01:26:41.263836 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:41.275161 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:41.286322 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:41.297159 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:41.308182 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:26:41.319132 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:26:41.436063 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:26:41.557341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:26:42.059344 run create_hlr_db(pid=23940): Launched 01:26:42.184219 bus /sierra_2: Setting Powered False 01:26:43.248486 run create_hlr_db(pid=23940): Terminated: ok {rc=0} 01:26:43.701395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23942): Launched 01:26:44.026712 run osmo-hlr_10.42.42.2(pid=23943): Launched 01:26:44.152477 run osmo-stp_10.42.42.5: Starting osmo-stp 01:26:44.712355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23945): Launched 01:26:45.038992 run osmo-stp_10.42.42.5(pid=23946): Launched 01:26:45.162978 run osmo-msc_10.42.42.6: Starting osmo-msc 01:26:45.750764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23948): Launched 01:26:46.092637 run osmo-msc_10.42.42.6(pid=23949): Launched 01:26:46.399172 run osmo-stp_10.42.42.5(pid=23946): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23946)] 01:26:46.559978 run osmo-stp_10.42.42.5(pid=23946): stdout: | (launched: 2022-12-14_01:26:44.978661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:46.778204 run osmo-stp_10.42.42.5(pid=23946): stderr: | [0;m[38;5;43m20221214012645171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012645171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012645171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012645171 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012645172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012645172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012645172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:47.027116 run osmo-stp_10.42.42.5(pid=23946): stdout: | (launched: 2022-12-14_01:26:44.978661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:47.152888 run osmo-stp_10.42.42.5(pid=23946): stderr: | [0;m[38;5;43m20221214012645171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012645171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012645171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012645171 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012645172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012645172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012645172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:47.299999 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23946): Process ended prematurely: osmo-stp_10.42.42.5(pid=23946) [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23946)] [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 01:26:47.309695 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 01:26:47.336771 run osmo-hlr_10.42.42.2(pid=23943): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23943)] 01:26:47.385079 run osmo-hlr_10.42.42.2(pid=23943): stdout: | (launched: 2022-12-14_01:26:43.966734) 01:26:47.434212 run osmo-hlr_10.42.42.2(pid=23943): stderr: | [0;m[1;31m20221214012644164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012644164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012644164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012644164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012644164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012644164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012644177 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012644185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012644185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012644186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:26:47.503121 run osmo-msc_10.42.42.6(pid=23949): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23949)] 01:26:47.550770 run osmo-msc_10.42.42.6(pid=23949): stdout: | (launched: 2022-12-14_01:26:46.034038) 01:26:47.600339 run osmo-msc_10.42.42.6(pid=23949): stderr: | [0;m[38;5;43m20221214012646592 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214012646592 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc6fbbe8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214012646592 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214012646592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214012646592 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214012646597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214012646599 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214012646599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214012646600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214012646600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:26:47.650067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23942): Terminating (SIGTERM) 01:26:47.689959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23945): Terminating (SIGTERM) 01:26:47.729624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23948): Terminating (SIGTERM) 01:26:47.769648 --- ParallelTerminationStrategy: PID 23942 died... 01:26:47.789027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23942): Terminated: ok {rc=0} 01:26:47.832610 --- ParallelTerminationStrategy: PID 23945 died... 01:26:47.851356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23945): Terminated: ok {rc=0} 01:26:47.894668 --- ParallelTerminationStrategy: PID 23948 died... 01:26:47.913306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23948): Terminated: ok {rc=0} 01:26:47.998979 bus /sierra_3: Setting Powered False 01:26:49.097645 bus /sierra_3: Setting Powered False 01:26:50.212528 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 01:26:51.470601 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:26:51.477810 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 01:26:51.511979 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 01:26:51.540119 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 01:26:51.593710 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 01:26:51.627680 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 01:26:51.655854 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 01:26:52.209903 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 01:26:52.263299 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:26:52.275406 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:26:52.346709 tst mo_mt_call.py: using LAC 37588 01:26:52.473659 tst mo_mt_call.py: using RAC 103 01:26:52.592858 tst mo_mt_call.py: using CellId 37588 01:26:52.709990 tst mo_mt_call.py: using BVCI 37589 01:26:52.818673 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:26:52.829894 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:26:52.840890 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:26:52.851882 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:26:52.862885 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:26:52.873772 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:26:52.993836 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:26:53.110536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:26:53.580856 run create_hlr_db(pid=23954): Launched 01:26:53.703336 bus /sierra_2: Setting Powered False 01:26:54.766613 run create_hlr_db(pid=23954): Terminated: ok {rc=0} 01:26:55.218279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23956): Launched 01:26:55.543700 run osmo-hlr_10.42.42.2(pid=23957): Launched 01:26:55.668467 run osmo-stp_10.42.42.5: Starting osmo-stp 01:26:56.226722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23959): Launched 01:26:56.550785 run osmo-stp_10.42.42.5(pid=23960): Launched 01:26:56.674959 run osmo-msc_10.42.42.6: Starting osmo-msc 01:26:57.257624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23962): Launched 01:26:57.583990 run osmo-msc_10.42.42.6(pid=23963): Launched 01:26:57.763079 run osmo-stp_10.42.42.5(pid=23960): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23960)] 01:26:57.900500 run osmo-stp_10.42.42.5(pid=23960): stdout: | (launched: 2022-12-14_01:26:56.491125) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:58.036849 run osmo-stp_10.42.42.5(pid=23960): stderr: | [0;m[38;5;43m20221214012656684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012656684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012656684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012656685 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012656685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012656685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012656685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:58.172738 run osmo-stp_10.42.42.5(pid=23960): stdout: | (launched: 2022-12-14_01:26:56.491125) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:26:58.301176 run osmo-stp_10.42.42.5(pid=23960): stderr: | [0;m[38;5;43m20221214012656684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012656684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012656684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012656685 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012656685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012656685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012656685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:26:58.454693 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23960): Process ended prematurely: osmo-stp_10.42.42.5(pid=23960) [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23960)] [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 01:26:58.464075 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 01:26:58.491956 run osmo-hlr_10.42.42.2(pid=23957): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23957)] 01:26:58.542647 run osmo-hlr_10.42.42.2(pid=23957): stdout: | (launched: 2022-12-14_01:26:55.483825) 01:26:58.594839 run osmo-hlr_10.42.42.2(pid=23957): stderr: | [0;m[1;31m20221214012655682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012655682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012655682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012655682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012655682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012655682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012655694 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012655702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012655703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012655703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:26:58.667148 run osmo-msc_10.42.42.6(pid=23963): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23963)] 01:26:58.716839 run osmo-msc_10.42.42.6(pid=23963): stdout: | (launched: 2022-12-14_01:26:57.522934) 01:26:58.769114 run osmo-msc_10.42.42.6(pid=23963): stderr: | [0;m[38;5;43m20221214012657848 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214012657849 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8697178c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214012657849 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214012657849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214012657849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214012657849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214012657851 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214012657851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214012657851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214012657851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:26:58.821679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23956): Terminating (SIGTERM) 01:26:58.863245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23959): Terminating (SIGTERM) 01:26:58.905180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23962): Terminating (SIGTERM) 01:26:58.947621 --- ParallelTerminationStrategy: PID 23956 died... 01:26:58.967936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23956): Terminated: ok {rc=0} 01:26:59.014561 --- ParallelTerminationStrategy: PID 23959 died... 01:26:59.034328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23959): Terminated: ok {rc=0} 01:26:59.080353 --- ParallelTerminationStrategy: PID 23962 died... 01:26:59.100691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23962): Terminated: ok {rc=0} 01:26:59.190358 bus /sierra_3: Setting Powered False 01:27:00.287525 bus /sierra_3: Setting Powered False 01:27:01.404433 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 01:27:02.557570 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:27:02.569373 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:27:02.639629 tst mo_mt_call_osmux.py: using LAC 37589 01:27:02.758265 tst mo_mt_call_osmux.py: using RAC 104 01:27:02.877556 tst mo_mt_call_osmux.py: using CellId 37589 01:27:02.997206 tst mo_mt_call_osmux.py: using BVCI 37590 01:27:03.106988 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:27:03.118579 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:27:03.129707 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:27:03.140762 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:27:03.151779 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:27:03.162742 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:27:03.278528 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:27:03.416783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:27:03.920525 run create_hlr_db(pid=23965): Launched 01:27:04.045818 bus /sierra_2: Setting Powered False 01:27:05.109664 run create_hlr_db(pid=23965): Terminated: ok {rc=0} 01:27:05.544872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23967): Launched 01:27:05.849570 run osmo-hlr_10.42.42.2(pid=23968): Launched 01:27:05.977030 run osmo-stp_10.42.42.5: Starting osmo-stp 01:27:06.537887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23970): Launched 01:27:06.862787 run osmo-stp_10.42.42.5(pid=23971): Launched 01:27:06.988336 run osmo-msc_10.42.42.6: Starting osmo-msc 01:27:07.576708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23973): Launched 01:27:07.905429 run osmo-msc_10.42.42.6(pid=23974): Launched 01:27:08.090900 run osmo-stp_10.42.42.5(pid=23971): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23971)] 01:27:08.227862 run osmo-stp_10.42.42.5(pid=23971): stdout: | (launched: 2022-12-14_01:27:06.802710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:08.367141 run osmo-stp_10.42.42.5(pid=23971): stderr: | [0;m[38;5;43m20221214012706994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012706994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012706994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012706994 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012706995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012706995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012706995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:08.504065 run osmo-stp_10.42.42.5(pid=23971): stdout: | (launched: 2022-12-14_01:27:06.802710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:08.633427 run osmo-stp_10.42.42.5(pid=23971): stderr: | [0;m[38;5;43m20221214012706994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012706994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012706994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012706994 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012706995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012706995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012706995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:08.788542 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23971): Process ended prematurely: osmo-stp_10.42.42.5(pid=23971) [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23971)] [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 01:27:08.798601 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:27:08.826992 run osmo-hlr_10.42.42.2(pid=23968): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23968)] 01:27:08.878429 run osmo-hlr_10.42.42.2(pid=23968): stdout: | (launched: 2022-12-14_01:27:05.792210) 01:27:08.931000 run osmo-hlr_10.42.42.2(pid=23968): stderr: | [0;m[1;31m20221214012705983 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012705984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012705984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012705984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012705984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012705984 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012705997 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012706005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012706005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012706005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:27:09.004134 run osmo-msc_10.42.42.6(pid=23974): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23974)] 01:27:09.054160 run osmo-msc_10.42.42.6(pid=23974): stdout: | (launched: 2022-12-14_01:27:07.844783) 01:27:09.106587 run osmo-msc_10.42.42.6(pid=23974): stderr: | [0;m[38;5;43m20221214012708168 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214012708168 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdc64320c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214012708168 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214012708168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214012708168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214012708169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214012708170 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214012708171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214012708171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214012708171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:27:09.159183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23967): Terminating (SIGTERM) 01:27:09.201904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23970): Terminating (SIGTERM) 01:27:09.244589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23973): Terminating (SIGTERM) 01:27:09.287818 --- ParallelTerminationStrategy: PID 23967 died... 01:27:09.308528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23967): Terminated: ok {rc=0} 01:27:09.355298 --- ParallelTerminationStrategy: PID 23970 died... 01:27:09.375421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23970): Terminated: ok {rc=0} 01:27:09.421935 --- ParallelTerminationStrategy: PID 23973 died... 01:27:09.441943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23973): Terminated: ok {rc=0} 01:27:09.530758 bus /sierra_3: Setting Powered False 01:27:10.628845 bus /sierra_3: Setting Powered False 01:27:11.745144 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:27:13.006234 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:27:13.013448 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:27:13.047502 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:27:13.076656 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:27:13.129160 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:27:13.161494 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:27:13.187547 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:27:13.739086 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:27:13.787242 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:13.798454 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:27:13.866238 tst mo_mt_call.py: using LAC 37590 01:27:13.983620 tst mo_mt_call.py: using RAC 105 01:27:14.100784 tst mo_mt_call.py: using CellId 37590 01:27:14.217745 tst mo_mt_call.py: using BVCI 37591 01:27:14.327063 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:14.338109 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:14.348942 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:14.359774 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:14.370771 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:14.381581 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:27:14.500707 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:27:14.620694 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:27:15.122181 run create_hlr_db(pid=23979): Launched 01:27:15.247650 bus /sierra_2: Setting Powered False 01:27:16.347414 run create_hlr_db(pid=23979): Terminated: ok {rc=0} 01:27:16.794649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23981): Launched 01:27:17.117634 run osmo-hlr_10.42.42.2(pid=23982): Launched 01:27:17.285365 run osmo-stp_10.42.42.5: Starting osmo-stp 01:27:17.803678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23984): Launched 01:27:18.105793 run osmo-stp_10.42.42.5(pid=23985): Launched 01:27:18.220448 run osmo-msc_10.42.42.6: Starting osmo-msc 01:27:18.769643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23987): Launched 01:27:19.074360 run osmo-msc_10.42.42.6(pid=23988): Launched 01:27:19.244881 run osmo-stp_10.42.42.5(pid=23985): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23985)] 01:27:19.372549 run osmo-stp_10.42.42.5(pid=23985): stdout: | (launched: 2022-12-14_01:27:18.049373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:19.500086 run osmo-stp_10.42.42.5(pid=23985): stderr: | [0;m[38;5;43m20221214012718220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012718220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012718220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012718220 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012718221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012718221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012718221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:19.625360 run osmo-stp_10.42.42.5(pid=23985): stdout: | (launched: 2022-12-14_01:27:18.049373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:19.745421 run osmo-stp_10.42.42.5(pid=23985): stderr: | [0;m[38;5;43m20221214012718220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012718220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012718220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012718220 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012718221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012718221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012718221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:19.888583 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23985): Process ended prematurely: osmo-stp_10.42.42.5(pid=23985) [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23985)] [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:27:19.897550 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:27:19.923546 run osmo-hlr_10.42.42.2(pid=23982): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23982)] 01:27:19.970343 run osmo-hlr_10.42.42.2(pid=23982): stdout: | (launched: 2022-12-14_01:27:17.060562) 01:27:20.019051 run osmo-hlr_10.42.42.2(pid=23982): stderr: | [0;m[1;31m20221214012717269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012717269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012717269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012717269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012717269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012717269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012717282 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012717290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012717290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012717290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:27:20.086929 run osmo-msc_10.42.42.6(pid=23988): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23988)] 01:27:20.133974 run osmo-msc_10.42.42.6(pid=23988): stdout: | (launched: 2022-12-14_01:27:19.017561) 01:27:20.182620 run osmo-msc_10.42.42.6(pid=23988): stderr: | [0;m[38;5;43m20221214012719288 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214012719288 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd5eb76fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214012719289 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214012719289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214012719289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214012719289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214012719291 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214012719291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214012719291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214012719291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:27:20.231731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23981): Terminating (SIGTERM) 01:27:20.270656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23984): Terminating (SIGTERM) 01:27:20.309601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23987): Terminating (SIGTERM) 01:27:20.348678 --- ParallelTerminationStrategy: PID 23981 died... 01:27:20.367598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23981): Terminated: ok {rc=0} 01:27:20.410825 --- ParallelTerminationStrategy: PID 23984 died... 01:27:20.429226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23984): Terminated: ok {rc=0} 01:27:20.472189 --- ParallelTerminationStrategy: PID 23987 died... 01:27:20.490525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23987): Terminated: ok {rc=0} 01:27:20.575430 bus /sierra_3: Setting Powered False 01:27:21.674323 bus /sierra_3: Setting Powered False 01:27:22.788774 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:27:23.934687 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:23.946552 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:27:24.016189 tst mo_mt_call_osmux.py: using LAC 37591 01:27:24.135064 tst mo_mt_call_osmux.py: using RAC 106 01:27:24.255433 tst mo_mt_call_osmux.py: using CellId 37591 01:27:24.375413 tst mo_mt_call_osmux.py: using BVCI 37592 01:27:24.485833 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:24.496848 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:24.507774 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:24.518648 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:24.529611 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:27:24.540469 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:27:24.659899 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:27:24.776843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:27:25.245460 run create_hlr_db(pid=23990): Launched 01:27:25.370572 bus /sierra_2: Setting Powered False 01:27:26.430957 run create_hlr_db(pid=23990): Terminated: ok {rc=0} 01:27:26.872874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23992): Launched 01:27:27.199209 run osmo-hlr_10.42.42.2(pid=23993): Launched 01:27:27.324137 run osmo-stp_10.42.42.5: Starting osmo-stp 01:27:27.883054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23995): Launched 01:27:28.208333 run osmo-stp_10.42.42.5(pid=23996): Launched 01:27:28.333152 run osmo-msc_10.42.42.6: Starting osmo-msc 01:27:28.918452 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23998): Launched 01:27:29.244186 run osmo-msc_10.42.42.6(pid=23999): Launched 01:27:29.426799 run osmo-stp_10.42.42.5(pid=23996): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23996)] 01:27:29.563128 run osmo-stp_10.42.42.5(pid=23996): stdout: | (launched: 2022-12-14_01:27:28.148517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:29.700593 run osmo-stp_10.42.42.5(pid=23996): stderr: | [0;m[38;5;43m20221214012728341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012728341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012728341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012728342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012728342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012728342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012728342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:29.837258 run osmo-stp_10.42.42.5(pid=23996): stdout: | (launched: 2022-12-14_01:27:28.148517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:29.965907 run osmo-stp_10.42.42.5(pid=23996): stderr: | [0;m[38;5;43m20221214012728341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012728341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012728341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012728342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012728342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012728342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012728342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:30.119988 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23996): Process ended prematurely: osmo-stp_10.42.42.5(pid=23996) [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23996)] [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:27:30.129808 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:27:30.158117 run osmo-hlr_10.42.42.2(pid=23993): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23993)] 01:27:30.209170 run osmo-hlr_10.42.42.2(pid=23993): stdout: | (launched: 2022-12-14_01:27:27.139419) 01:27:30.261772 run osmo-hlr_10.42.42.2(pid=23993): stderr: | [0;m[1;31m20221214012727338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012727338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012727338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012727338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012727338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012727338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012727375 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012727385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012727385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012727386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:27:30.334811 run osmo-msc_10.42.42.6(pid=23999): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23999)] 01:27:30.385310 run osmo-msc_10.42.42.6(pid=23999): stdout: | (launched: 2022-12-14_01:27:29.184075) 01:27:30.437830 run osmo-msc_10.42.42.6(pid=23999): stderr: | [0;m[38;5;43m20221214012729507 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214012729507 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbd320c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214012729507 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214012729507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214012729507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214012729508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214012729509 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214012729510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214012729510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214012729510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:27:30.490438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23992): Terminating (SIGTERM) 01:27:30.532357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23995): Terminating (SIGTERM) 01:27:30.574945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23998): Terminating (SIGTERM) 01:27:30.617750 --- ParallelTerminationStrategy: PID 23992 died... 01:27:30.638493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23992): Terminated: ok {rc=0} 01:27:30.685468 --- ParallelTerminationStrategy: PID 23995 died... 01:27:30.705511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23995): Terminated: ok {rc=0} 01:27:30.752140 --- ParallelTerminationStrategy: PID 23998 died... 01:27:30.772769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23998): Terminated: ok {rc=0} 01:27:30.867002 bus /sierra_3: Setting Powered False 01:27:31.967825 bus /sierra_3: Setting Powered False 01:27:33.082788 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:27:34.335912 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:27:34.342617 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:27:34.375136 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:27:34.402287 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:27:34.456186 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:27:34.489973 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:27:34.516936 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:27:35.070328 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:27:35.120828 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:35.131954 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:27:35.201332 tst mo_mt_call.py: using LAC 37592 01:27:35.318890 tst mo_mt_call.py: using RAC 107 01:27:35.437752 tst mo_mt_call.py: using CellId 37592 01:27:35.553996 tst mo_mt_call.py: using BVCI 37593 01:27:35.662428 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:35.673989 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:35.685016 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:35.695998 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:35.707016 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:35.717974 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:27:35.837390 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:27:35.954158 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:27:36.421588 run create_hlr_db(pid=24004): Launched 01:27:36.546298 bus /sierra_2: Setting Powered False 01:27:37.606560 run create_hlr_db(pid=24004): Terminated: ok {rc=0} 01:27:38.030343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24006): Launched 01:27:38.334713 run osmo-hlr_10.42.42.2(pid=24007): Launched 01:27:38.449664 run osmo-stp_10.42.42.5: Starting osmo-stp 01:27:38.970579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24009): Launched 01:27:39.273136 run osmo-stp_10.42.42.5(pid=24010): Launched 01:27:39.387615 run osmo-msc_10.42.42.6: Starting osmo-msc 01:27:39.934942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24012): Launched 01:27:40.239589 run osmo-msc_10.42.42.6(pid=24013): Launched 01:27:40.408141 run osmo-stp_10.42.42.5(pid=24010): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24010)] 01:27:40.534926 run osmo-stp_10.42.42.5(pid=24010): stdout: | (launched: 2022-12-14_01:27:39.216563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:40.662330 run osmo-stp_10.42.42.5(pid=24010): stderr: | [0;m[38;5;43m20221214012739388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012739388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012739389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012739389 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012739390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012739390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012739390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:40.788157 run osmo-stp_10.42.42.5(pid=24010): stdout: | (launched: 2022-12-14_01:27:39.216563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:40.907694 run osmo-stp_10.42.42.5(pid=24010): stderr: | [0;m[38;5;43m20221214012739388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012739388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012739389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012739389 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012739390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012739390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012739390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:41.051440 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24010): Process ended prematurely: osmo-stp_10.42.42.5(pid=24010) [trial-2397↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24010)] [trial-2397↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:27:41.060570 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 01:27:41.087189 run osmo-hlr_10.42.42.2(pid=24007): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24007)] 01:27:41.134683 run osmo-hlr_10.42.42.2(pid=24007): stdout: | (launched: 2022-12-14_01:27:38.278047) 01:27:41.183773 run osmo-hlr_10.42.42.2(pid=24007): stderr: | [0;m[1;31m20221214012738455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012738455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012738455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012738455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012738455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012738455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012738487 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012738496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012738497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012738497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:27:41.252315 run osmo-msc_10.42.42.6(pid=24013): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24013)] 01:27:41.299443 run osmo-msc_10.42.42.6(pid=24013): stdout: | (launched: 2022-12-14_01:27:40.183067) 01:27:41.348247 run osmo-msc_10.42.42.6(pid=24013): stderr: | [0;m[38;5;43m20221214012740458 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214012740458 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f17cd5a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214012740458 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214012740458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214012740458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214012740459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214012740460 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214012740461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214012740461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214012740461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:27:41.397644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24006): Terminating (SIGTERM) 01:27:41.437250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24009): Terminating (SIGTERM) 01:27:41.476299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24012): Terminating (SIGTERM) 01:27:41.515507 --- ParallelTerminationStrategy: PID 24006 died... 01:27:41.534622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24006): Terminated: ok {rc=0} 01:27:41.578278 --- ParallelTerminationStrategy: PID 24009 died... 01:27:41.596864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24009): Terminated: ok {rc=0} 01:27:41.640225 --- ParallelTerminationStrategy: PID 24012 died... 01:27:41.658581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24012): Terminated: ok {rc=0} 01:27:41.743525 bus /sierra_3: Setting Powered False 01:27:42.842509 bus /sierra_3: Setting Powered False 01:27:43.956262 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:27:45.101923 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:45.113781 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:27:45.184073 tst mo_mt_call_osmux.py: using LAC 37593 01:27:45.311941 tst mo_mt_call_osmux.py: using RAC 108 01:27:45.439883 tst mo_mt_call_osmux.py: using CellId 37593 01:27:45.569175 tst mo_mt_call_osmux.py: using BVCI 37594 01:27:45.687493 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:45.699347 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:45.711039 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:45.722514 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:45.734425 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:27:45.746246 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:27:45.866497 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:27:45.994872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:27:46.528819 run create_hlr_db(pid=24015): Launched 01:27:46.687594 bus /sierra_2: Setting Powered False 01:27:47.752152 run create_hlr_db(pid=24015): Terminated: ok {rc=0} 01:27:48.187229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24017): Launched 01:27:48.492803 run osmo-hlr_10.42.42.2(pid=24018): Launched 01:27:48.608232 run osmo-stp_10.42.42.5: Starting osmo-stp 01:27:49.129565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24020): Launched 01:27:49.434630 run osmo-stp_10.42.42.5(pid=24021): Launched 01:27:49.551580 run osmo-msc_10.42.42.6: Starting osmo-msc 01:27:50.104724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24023): Launched 01:27:50.410101 run osmo-msc_10.42.42.6(pid=24024): Launched 01:27:50.582337 run osmo-stp_10.42.42.5(pid=24021): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24021)] 01:27:50.711399 run osmo-stp_10.42.42.5(pid=24021): stdout: | (launched: 2022-12-14_01:27:49.377406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:50.839907 run osmo-stp_10.42.42.5(pid=24021): stderr: | [0;m[38;5;43m20221214012749549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012749549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012749549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012749550 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012749550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012749550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012749550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:50.966707 run osmo-stp_10.42.42.5(pid=24021): stdout: | (launched: 2022-12-14_01:27:49.377406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:27:51.087496 run osmo-stp_10.42.42.5(pid=24021): stderr: | [0;m[38;5;43m20221214012749549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012749549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012749549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012749550 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012749550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012749550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012749550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:27:51.231997 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24021): Process ended prematurely: osmo-stp_10.42.42.5(pid=24021) [trial-2397↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24021)] [trial-2397↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:27:51.240928 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:27:51.267493 run osmo-hlr_10.42.42.2(pid=24018): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24018)] 01:27:51.314727 run osmo-hlr_10.42.42.2(pid=24018): stdout: | (launched: 2022-12-14_01:27:48.436100) 01:27:51.363561 run osmo-hlr_10.42.42.2(pid=24018): stderr: | [0;m[1;31m20221214012748613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012748613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012748613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012748613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012748613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012748613 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012748625 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012748634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012748634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012748634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:27:51.431803 run osmo-msc_10.42.42.6(pid=24024): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24024)] 01:27:51.478894 run osmo-msc_10.42.42.6(pid=24024): stdout: | (launched: 2022-12-14_01:27:50.352826) 01:27:51.528208 run osmo-msc_10.42.42.6(pid=24024): stderr: | [0;m[38;5;43m20221214012750625 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214012750625 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdce10f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214012750625 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214012750625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214012750625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214012750626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214012750627 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214012750628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214012750628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214012750628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:27:51.577523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24017): Terminating (SIGTERM) 01:27:51.617108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24020): Terminating (SIGTERM) 01:27:51.656676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24023): Terminating (SIGTERM) 01:27:51.696434 --- ParallelTerminationStrategy: PID 24017 died... 01:27:51.715579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24017): Terminated: ok {rc=0} 01:27:51.759258 --- ParallelTerminationStrategy: PID 24020 died... 01:27:51.777819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24020): Terminated: ok {rc=0} 01:27:51.821242 --- ParallelTerminationStrategy: PID 24023 died... 01:27:51.839706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24023): Terminated: ok {rc=0} 01:27:51.925691 bus /sierra_3: Setting Powered False 01:27:53.025438 bus /sierra_3: Setting Powered False 01:27:54.140655 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:27:55.398401 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:27:55.405645 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:27:55.438647 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 01:27:55.465358 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 01:27:55.519539 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:27:55.553746 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 01:27:55.581785 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 01:27:56.129158 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 01:27:56.181892 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:27:56.193538 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:27:56.265180 tst mo_mt_call.py: using LAC 37594 01:27:56.391677 tst mo_mt_call.py: using RAC 109 01:27:56.519452 tst mo_mt_call.py: using CellId 37594 01:27:56.647735 tst mo_mt_call.py: using BVCI 37595 01:27:56.758331 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:27:56.769554 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:27:56.780210 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:27:56.790863 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:27:56.801518 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:27:56.812237 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:27:56.932263 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:27:57.048577 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:27:57.515283 run create_hlr_db(pid=24030): Launched 01:27:57.640940 bus /sierra_2: Setting Powered False 01:27:58.700737 run create_hlr_db(pid=24030): Terminated: ok {rc=0} 01:27:59.143566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24032): Launched 01:27:59.468585 run osmo-hlr_10.42.42.2(pid=24033): Launched 01:27:59.595066 run osmo-stp_10.42.42.5: Starting osmo-stp 01:28:00.155978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24035): Launched 01:28:00.482616 run osmo-stp_10.42.42.5(pid=24036): Launched 01:28:00.607316 run osmo-msc_10.42.42.6: Starting osmo-msc 01:28:01.219801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24038): Launched 01:28:01.533400 run osmo-msc_10.42.42.6(pid=24039): Launched 01:28:01.834539 run osmo-stp_10.42.42.5(pid=24036): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24036)] 01:28:02.044016 run osmo-stp_10.42.42.5(pid=24036): stdout: | (launched: 2022-12-14_01:28:00.422755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:02.320529 run osmo-stp_10.42.42.5(pid=24036): stderr: | [0;m[38;5;43m20221214012800614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012800614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012800614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012800614 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012800615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012800615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012800615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:02.458773 run osmo-stp_10.42.42.5(pid=24036): stdout: | (launched: 2022-12-14_01:28:00.422755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:02.588114 run osmo-stp_10.42.42.5(pid=24036): stderr: | [0;m[38;5;43m20221214012800614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012800614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012800614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012800614 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012800615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012800615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012800615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:02.742900 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24036): Process ended prematurely: osmo-stp_10.42.42.5(pid=24036) [trial-2397↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24036)] [trial-2397↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 01:28:02.752839 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 01:28:02.780828 run osmo-hlr_10.42.42.2(pid=24033): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24033)] 01:28:02.832106 run osmo-hlr_10.42.42.2(pid=24033): stdout: | (launched: 2022-12-14_01:27:59.408621) 01:28:02.884352 run osmo-hlr_10.42.42.2(pid=24033): stderr: | [0;m[1;31m20221214012759608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012759608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012759608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012759608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012759608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012759608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012759620 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012759629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012759629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012759629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:28:02.957182 run osmo-msc_10.42.42.6(pid=24039): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24039)] 01:28:03.007175 run osmo-msc_10.42.42.6(pid=24039): stdout: | (launched: 2022-12-14_01:28:01.475579) 01:28:03.059731 run osmo-msc_10.42.42.6(pid=24039): stderr: | [0;m[38;5;43m20221214012802101 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214012802101 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc0a72cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214012802101 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214012802101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214012802102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214012802102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214012802106 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214012802106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214012802106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214012802106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:28:03.112144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24032): Terminating (SIGTERM) 01:28:03.153954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24035): Terminating (SIGTERM) 01:28:03.196114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24038): Terminating (SIGTERM) 01:28:03.238360 --- ParallelTerminationStrategy: PID 24032 died... 01:28:03.258940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24032): Terminated: ok {rc=0} 01:28:03.305906 --- ParallelTerminationStrategy: PID 24035 died... 01:28:03.325904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24035): Terminated: ok {rc=0} 01:28:03.372268 --- ParallelTerminationStrategy: PID 24038 died... 01:28:03.392293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24038): Terminated: ok {rc=0} 01:28:03.480513 bus /sierra_3: Setting Powered False 01:28:04.578578 bus /sierra_3: Setting Powered False 01:28:05.695481 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 01:28:06.844496 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:28:06.856798 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:28:06.931068 tst mo_mt_call_osmux.py: using LAC 37595 01:28:07.049846 tst mo_mt_call_osmux.py: using RAC 110 01:28:07.177393 tst mo_mt_call_osmux.py: using CellId 37595 01:28:07.305786 tst mo_mt_call_osmux.py: using BVCI 37596 01:28:07.416501 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:28:07.427596 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:28:07.438627 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:28:07.449865 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:28:07.461548 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:28:07.472803 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:28:07.594421 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:28:07.716516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:28:08.219203 run create_hlr_db(pid=24041): Launched 01:28:08.343859 bus /sierra_2: Setting Powered False 01:28:09.407529 run create_hlr_db(pid=24041): Terminated: ok {rc=0} 01:28:09.843544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24043): Launched 01:28:10.149405 run osmo-hlr_10.42.42.2(pid=24044): Launched 01:28:10.265442 run osmo-stp_10.42.42.5: Starting osmo-stp 01:28:10.794296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24046): Launched 01:28:11.097661 run osmo-stp_10.42.42.5(pid=24047): Launched 01:28:11.213006 run osmo-msc_10.42.42.6: Starting osmo-msc 01:28:11.762164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24049): Launched 01:28:12.065410 run osmo-msc_10.42.42.6(pid=24050): Launched 01:28:12.234576 run osmo-stp_10.42.42.5(pid=24047): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24047)] 01:28:12.362893 run osmo-stp_10.42.42.5(pid=24047): stdout: | (launched: 2022-12-14_01:28:11.040777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:12.491266 run osmo-stp_10.42.42.5(pid=24047): stderr: | [0;m[38;5;43m20221214012811212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012811212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012811212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012811212 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012811213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012811213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012811213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:12.617464 run osmo-stp_10.42.42.5(pid=24047): stdout: | (launched: 2022-12-14_01:28:11.040777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:12.737627 run osmo-stp_10.42.42.5(pid=24047): stderr: | [0;m[38;5;43m20221214012811212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012811212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012811212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012811212 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012811213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012811213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012811213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:12.881857 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24047): Process ended prematurely: osmo-stp_10.42.42.5(pid=24047) [trial-2397↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24047)] [trial-2397↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 01:28:12.890702 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:28:12.917171 run osmo-hlr_10.42.42.2(pid=24044): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24044)] 01:28:12.964242 run osmo-hlr_10.42.42.2(pid=24044): stdout: | (launched: 2022-12-14_01:28:10.092300) 01:28:13.012862 run osmo-hlr_10.42.42.2(pid=24044): stderr: | [0;m[1;31m20221214012810270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012810270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012810270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012810271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012810271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012810271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012810283 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012810291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012810292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012810292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:28:13.080897 run osmo-msc_10.42.42.6(pid=24050): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24050)] 01:28:13.128020 run osmo-msc_10.42.42.6(pid=24050): stdout: | (launched: 2022-12-14_01:28:12.008723) 01:28:13.176694 run osmo-msc_10.42.42.6(pid=24050): stderr: | [0;m[38;5;43m20221214012812279 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214012812279 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f46017dec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214012812279 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214012812279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214012812279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214012812280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214012812281 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214012812282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214012812282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214012812282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:28:13.225736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24043): Terminating (SIGTERM) 01:28:13.265047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24046): Terminating (SIGTERM) 01:28:13.304394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24049): Terminating (SIGTERM) 01:28:13.343946 --- ParallelTerminationStrategy: PID 24043 died... 01:28:13.362909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24043): Terminated: ok {rc=0} 01:28:13.406371 --- ParallelTerminationStrategy: PID 24046 died... 01:28:13.425012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24046): Terminated: ok {rc=0} 01:28:13.468682 --- ParallelTerminationStrategy: PID 24049 died... 01:28:13.487399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24049): Terminated: ok {rc=0} 01:28:13.571748 bus /sierra_3: Setting Powered False 01:28:14.669802 bus /sierra_3: Setting Powered False 01:28:15.786756 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 emergency:trx-lms --------------------------------------------------------------------- 01:28:17.070809 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:28:17.075743 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 01:28:17.114050 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 01:28:17.143587 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 01:28:17.232834 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 01:28:17.268741 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 01:28:17.297690 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 01:28:17.878974 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2397 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 01:28:17.884522 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:17.895689 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 01:28:17.949950 tst emergency_mo_mt_call.py: using LAC 37596 01:28:18.075813 tst emergency_mo_mt_call.py: using RAC 111 01:28:18.201399 tst emergency_mo_mt_call.py: using CellId 37596 01:28:18.325247 tst emergency_mo_mt_call.py: using BVCI 37597 01:28:18.441300 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:18.452429 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:18.463422 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:18.474457 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:18.485745 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:18.496820 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 01:28:18.613352 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 01:28:18.735088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:28:19.225813 run create_hlr_db(pid=24055): Launched 01:28:19.349196 bus /sierra_2: Setting Powered False 01:28:20.412519 run create_hlr_db(pid=24055): Terminated: ok {rc=0} 01:28:20.838619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24057): Launched 01:28:21.135343 run osmo-hlr_10.42.42.2(pid=24058): Launched 01:28:21.247990 run osmo-stp_10.42.42.5: Starting osmo-stp 01:28:21.776889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24060): Launched 01:28:22.074088 run osmo-stp_10.42.42.5(pid=24061): Launched 01:28:22.198181 tst emergency_mo_mt_call.py: using MSISDN 8430 01:28:22.349595 run osmo-msc_10.42.42.6: Starting osmo-msc 01:28:22.884199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24063): Launched 01:28:23.181171 run osmo-msc_10.42.42.6(pid=24064): Launched 01:28:23.347730 run osmo-stp_10.42.42.5(pid=24061): ERR: Terminated: ERROR {rc=1} [trial-2397↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24061)] 01:28:23.472459 run osmo-stp_10.42.42.5(pid=24061): stdout: | (launched: 2022-12-14_01:28:22.018344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:23.597081 run osmo-stp_10.42.42.5(pid=24061): stderr: | [0;m[38;5;43m20221214012822189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012822189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012822189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012822190 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012822191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012822191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012822191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:23.720030 run osmo-stp_10.42.42.5(pid=24061): stdout: | (launched: 2022-12-14_01:28:22.018344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:23.838293 run osmo-stp_10.42.42.5(pid=24061): stderr: | [0;m[38;5;43m20221214012822189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012822189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012822189 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012822190 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012822191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012822191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012822191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:23.978816 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=24061): Process ended prematurely: osmo-stp_10.42.42.5(pid=24061) [trial-2397↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24061)] [trial-2397↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 01:28:23.986995 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 01:28:24.012906 run osmo-hlr_10.42.42.2(pid=24058): ERR: Terminated: ERROR {rc=237} [trial-2397↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24058)] 01:28:24.060086 run osmo-hlr_10.42.42.2(pid=24058): stdout: | (launched: 2022-12-14_01:28:21.079413) 01:28:24.109173 run osmo-hlr_10.42.42.2(pid=24058): stderr: | [0;m[1;31m20221214012821255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012821255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012821256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012821256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012821256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012821256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012821268 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012821277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012821277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012821277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:28:24.177489 run osmo-msc_10.42.42.6(pid=24064): ERR: Terminated: ERROR {rc=2} [trial-2397↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24064)] 01:28:24.224452 run osmo-msc_10.42.42.6(pid=24064): stdout: | (launched: 2022-12-14_01:28:23.125354) 01:28:24.272888 run osmo-msc_10.42.42.6(pid=24064): stderr: | [0;m[38;5;43m20221214012823396 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214012823396 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd62cbecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214012823396 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214012823396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214012823397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214012823397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214012823399 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214012823399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214012823399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214012823399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:28:24.321621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24057): Terminating (SIGTERM) 01:28:24.360727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24060): Terminating (SIGTERM) 01:28:24.399941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24063): Terminating (SIGTERM) 01:28:24.439293 --- ParallelTerminationStrategy: PID 24057 died... 01:28:24.458200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24057): Terminated: ok {rc=0} 01:28:24.501739 --- ParallelTerminationStrategy: PID 24060 died... 01:28:24.520105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24060): Terminated: ok {rc=0} 01:28:24.563416 --- ParallelTerminationStrategy: PID 24063 died... 01:28:24.582019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24063): Terminated: ok {rc=0} 01:28:24.668904 bus /sierra_3: Setting Powered False 01:28:25.769300 bus /sierra_3: Setting Powered False 01:28:26.886167 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 01:28:27.974230 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:27.985610 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 01:28:28.035464 tst emergency_preemptive_call.py: using LAC 37597 01:28:28.167376 tst emergency_preemptive_call.py: using RAC 112 01:28:28.290734 tst emergency_preemptive_call.py: using CellId 37597 01:28:28.406778 tst emergency_preemptive_call.py: using BVCI 37598 01:28:28.514814 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:28.525495 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:28.535894 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:28.546827 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:28.557850 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 01:28:28.568794 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 01:28:28.682628 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 01:28:28.801205 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 01:28:28.915734 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 01:28:29.033986 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:28:29.528670 run create_hlr_db(pid=24066): Launched 01:28:29.652357 bus /sierra_2: Setting Powered False 01:28:30.715938 run create_hlr_db(pid=24066): Terminated: ok {rc=0} 01:28:31.180231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24068): Launched 01:28:31.514785 run osmo-hlr_10.42.42.2(pid=24069): Launched 01:28:31.832657 run osmo-stp_10.42.42.5: Starting osmo-stp 01:28:32.445244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24071): Launched 01:28:32.765597 run osmo-stp_10.42.42.5(pid=24072): Launched 01:28:32.898487 tst emergency_preemptive_call.py: using MSISDN 8431 01:28:33.060698 run osmo-msc_10.42.42.6: Starting osmo-msc 01:28:33.634064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24074): Launched 01:28:33.952273 run osmo-msc_10.42.42.6(pid=24075): Launched 01:28:34.129770 run osmo-stp_10.42.42.5(pid=24072): ERR: Terminated: ERROR {rc=1} [trial-2397↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24072)] 01:28:34.263199 run osmo-stp_10.42.42.5(pid=24072): stdout: | (launched: 2022-12-14_01:28:32.706385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:34.398072 run osmo-stp_10.42.42.5(pid=24072): stderr: | [0;m[38;5;43m20221214012832901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012832901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012832902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012832902 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012832903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012832903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012832903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:34.531559 run osmo-stp_10.42.42.5(pid=24072): stdout: | (launched: 2022-12-14_01:28:32.706385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:34.657618 run osmo-stp_10.42.42.5(pid=24072): stderr: | [0;m[38;5;43m20221214012832901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012832901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012832902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012832902 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012832903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012832903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012832903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:34.808671 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=24072): Process ended prematurely: osmo-stp_10.42.42.5(pid=24072) [trial-2397↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24072)] [trial-2397↪emergency:trx-lms↪emergency_preemptive_call.py:32] 01:28:34.817700 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 01:28:34.845018 run osmo-hlr_10.42.42.2(pid=24069): ERR: Terminated: ERROR {rc=237} [trial-2397↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24069)] 01:28:34.895736 run osmo-hlr_10.42.42.2(pid=24069): stdout: | (launched: 2022-12-14_01:28:31.454743) 01:28:34.947489 run osmo-hlr_10.42.42.2(pid=24069): stderr: | [0;m[1;31m20221214012831690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012831690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012831690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012831690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012831690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012831691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012831705 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012831714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012831715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012831715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:28:35.020203 run osmo-msc_10.42.42.6(pid=24075): ERR: Terminated: ERROR {rc=2} [trial-2397↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24075)] 01:28:35.070142 run osmo-msc_10.42.42.6(pid=24075): stdout: | (launched: 2022-12-14_01:28:33.893195) 01:28:35.122116 run osmo-msc_10.42.42.6(pid=24075): stderr: | [0;m[38;5;43m20221214012834213 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214012834213 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff17491bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214012834214 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214012834214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214012834214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214012834214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214012834216 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214012834216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214012834216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214012834216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:28:35.174739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24068): Terminating (SIGTERM) 01:28:35.216270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24071): Terminating (SIGTERM) 01:28:35.258487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24074): Terminating (SIGTERM) 01:28:35.301191 --- ParallelTerminationStrategy: PID 24068 died... 01:28:35.321852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24068): Terminated: ok {rc=0} 01:28:35.368208 --- ParallelTerminationStrategy: PID 24071 died... 01:28:35.388149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24071): Terminated: ok {rc=0} 01:28:35.434325 --- ParallelTerminationStrategy: PID 24074 died... 01:28:35.454148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24074): Terminated: ok {rc=0} 01:28:35.543228 bus /sierra_9: Setting Powered False 01:28:36.641803 bus /sierra_9: Setting Powered False 01:28:37.758479 bus /sierra_8: Setting Powered False 01:28:38.853795 bus /sierra_8: Setting Powered False 01:28:39.966817 bus /sierra_3: Setting Powered False 01:28:41.065962 bus /sierra_3: Setting Powered False 01:28:42.182164 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-lms --------------------------------------------------------------------- 01:28:43.454471 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:28:43.458794 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 01:28:43.491238 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 01:28:43.529667 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 01:28:43.615961 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 01:28:43.648912 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 01:28:43.692694 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 01:28:44.275474 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 01:28:44.325289 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:44.335858 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 01:28:44.384217 tst cs_paging_gprs_active.py: using LAC 37598 01:28:44.502961 tst cs_paging_gprs_active.py: using RAC 113 01:28:44.625904 tst cs_paging_gprs_active.py: using CellId 37598 01:28:44.744296 tst cs_paging_gprs_active.py: using BVCI 37599 01:28:44.854116 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:44.864657 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:44.875078 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:44.885522 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:44.896071 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:44.906667 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:44.917395 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:44.927884 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:44.938583 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:28:45.057855 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:28:45.177862 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:28:45.398247 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:28:45.725467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24080): Launched 01:28:46.019444 run iperf3-srv_10.42.42.10(pid=24081): Launched 01:28:46.167319 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:28:46.394448 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:28:46.725845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24082): Launched 01:28:47.025113 run iperf3-srv_10.42.42.10(pid=24083): Launched 01:28:47.175796 tst cs_paging_gprs_active.py:38: start network... 01:28:47.382980 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:28:47.852864 run create_hlr_db(pid=24084): Launched 01:28:47.976617 bus /sierra_2: Setting Powered False 01:28:49.037531 run create_hlr_db(pid=24084): Terminated: ok {rc=0} 01:28:49.481548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24086): Launched 01:28:49.808166 run osmo-hlr_10.42.42.2(pid=24087): Launched 01:28:49.932583 run osmo-stp_10.42.42.5: Starting osmo-stp 01:28:50.491963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24089): Launched 01:28:50.818942 run osmo-stp_10.42.42.5(pid=24090): Launched 01:28:50.943405 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:28:51.503663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24092): Launched 01:28:51.629807 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:28:51.904303 run patchelf(pid=24093): Launched 01:28:52.086771 run osmo-stp_10.42.42.5(pid=24090): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24090)] 01:28:52.223995 run osmo-stp_10.42.42.5(pid=24090): stdout: | (launched: 2022-12-14_01:28:50.758633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:52.363500 run osmo-stp_10.42.42.5(pid=24090): stderr: | [0;m[38;5;43m20221214012850953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012850953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012850954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012850954 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012850954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012850955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012850955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:52.502851 run osmo-stp_10.42.42.5(pid=24090): stdout: | (launched: 2022-12-14_01:28:50.758633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:28:52.635377 run osmo-stp_10.42.42.5(pid=24090): stderr: | [0;m[38;5;43m20221214012850953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012850953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012850954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012850954 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012850954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012850955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012850955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:28:52.792544 run patchelf(pid=24093): Terminating (SIGINT) 01:28:52.973943 run patchelf(pid=24093): Terminated: ok {rc=0} 01:28:53.104779 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24090): Process ended prematurely: osmo-stp_10.42.42.5(pid=24090) [trial-2397↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24090)] [trial-2397↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 01:28:53.114984 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:28:53.143373 run osmo-hlr_10.42.42.2(pid=24087): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24087)] 01:28:53.193954 run osmo-hlr_10.42.42.2(pid=24087): stdout: | (launched: 2022-12-14_01:28:49.747929) 01:28:53.245703 run osmo-hlr_10.42.42.2(pid=24087): stderr: | [0;m[1;31m20221214012849949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012849949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012849949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012849949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012849950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012849950 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012849962 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012849973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012849973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012849973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:28:53.298435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24080): Terminating (SIGTERM) 01:28:53.340244 run iperf3-srv_10.42.42.10(pid=24081): Terminating (SIGTERM) 01:28:53.382531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24082): Terminating (SIGTERM) 01:28:53.424374 run iperf3-srv_10.42.42.10(pid=24083): Terminating (SIGTERM) 01:28:53.466618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24086): Terminating (SIGTERM) 01:28:53.508456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24089): Terminating (SIGTERM) 01:28:53.550570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24092): Terminating (SIGTERM) 01:28:53.592706 --- ParallelTerminationStrategy: PID 24080 died... 01:28:53.613149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24080): Terminated: ok {rc=0} 01:28:53.659684 --- ParallelTerminationStrategy: PID 24081 died... 01:28:53.679413 run iperf3-srv_10.42.42.10(pid=24081): Terminated {rc=256} 01:28:53.725307 --- ParallelTerminationStrategy: PID 24082 died... 01:28:53.745238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24082): Terminated: ok {rc=0} 01:28:53.790961 --- ParallelTerminationStrategy: PID 24083 died... 01:28:53.810708 run iperf3-srv_10.42.42.10(pid=24083): Terminated {rc=256} 01:28:53.856464 --- ParallelTerminationStrategy: PID 24086 died... 01:28:53.876261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24086): Terminated: ok {rc=0} 01:28:53.921986 --- ParallelTerminationStrategy: PID 24089 died... 01:28:53.941722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24089): Terminated: ok {rc=0} 01:28:53.987424 --- ParallelTerminationStrategy: PID 24092 died... 01:28:54.007261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24092): Terminated: ok {rc=0} 01:28:54.094964 bus /gobi_0: Setting Powered False 01:28:55.192586 bus /gobi_0: Setting Powered False 01:28:56.306647 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms iperf3.py ---------------------------------------------- 01:28:57.453997 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:57.465380 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 01:28:57.517601 tst iperf3.py: using LAC 37599 01:28:57.635828 tst iperf3.py: using RAC 114 01:28:57.759986 tst iperf3.py: using CellId 37599 01:28:57.878304 tst iperf3.py: using BVCI 37600 01:28:57.989565 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:58.000122 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:58.010640 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:58.021053 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:58.032275 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:58.042998 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:58.053814 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:58.064321 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:28:58.075093 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:28:58.193633 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:28:58.413192 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:28:58.739777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24094): Launched 01:28:59.025393 run iperf3-srv_10.42.42.10(pid=24095): Launched 01:28:59.149239 tst iperf3.py:8: start network... 01:28:59.369310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:28:59.874018 run create_hlr_db(pid=24096): Launched 01:28:59.999794 bus /gobi_6: Setting Powered False 01:29:01.062228 run create_hlr_db(pid=24096): Terminated: ok {rc=0} 01:29:01.519986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24098): Launched 01:29:01.859863 run osmo-hlr_10.42.42.2(pid=24099): Launched 01:29:01.991372 run osmo-stp_10.42.42.5: Starting osmo-stp 01:29:02.643810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24101): Launched 01:29:02.969625 run osmo-stp_10.42.42.5(pid=24102): Launched 01:29:03.094480 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:29:03.654110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24104): Launched 01:29:03.778518 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:29:04.052634 run patchelf(pid=24105): Launched 01:29:04.235060 run osmo-stp_10.42.42.5(pid=24102): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24102)] 01:29:04.373116 run osmo-stp_10.42.42.5(pid=24102): stdout: | (launched: 2022-12-14_01:29:02.909574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:04.512586 run osmo-stp_10.42.42.5(pid=24102): stderr: | [0;m[38;5;43m20221214012903103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012903103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012903103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012903104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012903104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012903104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012903104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:04.652211 run osmo-stp_10.42.42.5(pid=24102): stdout: | (launched: 2022-12-14_01:29:02.909574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:04.785125 run osmo-stp_10.42.42.5(pid=24102): stderr: | [0;m[38;5;43m20221214012903103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012903103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012903103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012903104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012903104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012903104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012903104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:04.942161 run patchelf(pid=24105): Terminating (SIGINT) 01:29:05.124021 run patchelf(pid=24105): Terminated: ok {rc=0} 01:29:05.255557 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24102): Process ended prematurely: osmo-stp_10.42.42.5(pid=24102) [trial-2397↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24102)] [trial-2397↪gprs:trx-lms↪iperf3.py:8] 01:29:05.265772 tst iperf3.py:8: Test FAILED (7.8 sec) 01:29:05.294354 run osmo-hlr_10.42.42.2(pid=24099): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24099)] 01:29:05.345321 run osmo-hlr_10.42.42.2(pid=24099): stdout: | (launched: 2022-12-14_01:29:01.799493) 01:29:05.397816 run osmo-hlr_10.42.42.2(pid=24099): stderr: | [0;m[1;31m20221214012902188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012902188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012902188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012902188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012902188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012902188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012902203 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012902213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012902214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012902214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:29:05.450724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24094): Terminating (SIGTERM) 01:29:05.492785 run iperf3-srv_10.42.42.10(pid=24095): Terminating (SIGTERM) 01:29:05.534506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24098): Terminating (SIGTERM) 01:29:05.576766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24101): Terminating (SIGTERM) 01:29:05.618561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24104): Terminating (SIGTERM) 01:29:05.661038 --- ParallelTerminationStrategy: PID 24094 died... 01:29:05.681306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24094): Terminated: ok {rc=0} 01:29:05.727458 --- ParallelTerminationStrategy: PID 24095 died... 01:29:05.747232 run iperf3-srv_10.42.42.10(pid=24095): Terminated {rc=256} 01:29:05.793246 --- ParallelTerminationStrategy: PID 24098 died... 01:29:05.812861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24098): Terminated: ok {rc=0} 01:29:05.858928 --- ParallelTerminationStrategy: PID 24101 died... 01:29:05.878717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24101): Terminated: ok {rc=0} 01:29:05.924880 --- ParallelTerminationStrategy: PID 24104 died... 01:29:05.945185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24104): Terminated: ok {rc=0} 01:29:06.033476 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms iperf3m4.py ---------------------------------------------- 01:29:07.184384 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:07.196112 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 01:29:07.248406 tst iperf3m4.py: using LAC 37600 01:29:07.376090 tst iperf3m4.py: using RAC 115 01:29:07.503262 tst iperf3m4.py: using CellId 37600 01:29:07.632254 tst iperf3m4.py: using BVCI 37601 01:29:07.743933 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:07.754897 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:07.765575 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:07.776138 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:07.786858 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:07.797622 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:07.808370 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:07.819010 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:07.829751 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:29:07.945284 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:29:08.071580 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:29:08.188394 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:29:08.309510 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:29:08.528283 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:08.858371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24106): Launched 01:29:09.124395 run iperf3-srv_10.42.42.10(pid=24107): Launched 01:29:09.237590 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:29:09.439551 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:09.744539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24108): Launched 01:29:10.009360 run iperf3-srv_10.42.42.10(pid=24109): Launched 01:29:10.124479 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:29:10.326584 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:10.630845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24110): Launched 01:29:10.896596 run iperf3-srv_10.42.42.10(pid=24111): Launched 01:29:11.009215 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:29:11.210064 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:11.512575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24112): Launched 01:29:11.777415 run iperf3-srv_10.42.42.10(pid=24113): Launched 01:29:11.911928 tst iperf3m4.py:8: start network... 01:29:12.113703 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:29:12.581152 run create_hlr_db(pid=24114): Launched 01:29:12.705341 bus /gobi_6: Setting Powered False 01:29:13.765152 run create_hlr_db(pid=24114): Terminated: ok {rc=0} 01:29:14.187811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24116): Launched 01:29:14.492075 run osmo-hlr_10.42.42.2(pid=24117): Launched 01:29:14.608367 run osmo-stp_10.42.42.5: Starting osmo-stp 01:29:15.127548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24119): Launched 01:29:15.432220 run osmo-stp_10.42.42.5(pid=24120): Launched 01:29:15.548283 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:29:16.079380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24122): Launched 01:29:16.211989 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:29:16.475334 run patchelf(pid=24123): Launched 01:29:16.691672 run osmo-stp_10.42.42.5(pid=24120): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24120)] 01:29:16.825079 run osmo-stp_10.42.42.5(pid=24120): stdout: | (launched: 2022-12-14_01:29:15.375486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:16.971289 run osmo-stp_10.42.42.5(pid=24120): stderr: | [0;m[38;5;43m20221214012915546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012915546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012915546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012915546 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012915547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012915547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012915547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:17.116320 run osmo-stp_10.42.42.5(pid=24120): stdout: | (launched: 2022-12-14_01:29:15.375486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:17.252296 run osmo-stp_10.42.42.5(pid=24120): stderr: | [0;m[38;5;43m20221214012915546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012915546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012915546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012915546 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012915547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012915547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012915547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:17.410185 run patchelf(pid=24123): Terminating (SIGINT) 01:29:17.590926 run patchelf(pid=24123): Terminated: ok {rc=0} 01:29:17.721746 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24120): Process ended prematurely: osmo-stp_10.42.42.5(pid=24120) [trial-2397↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24120)] [trial-2397↪gprs:trx-lms↪iperf3m4.py:8] 01:29:17.732259 tst iperf3m4.py:8: Test FAILED (10.6 sec) 01:29:17.761410 run osmo-hlr_10.42.42.2(pid=24117): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24117)] 01:29:17.812376 run osmo-hlr_10.42.42.2(pid=24117): stdout: | (launched: 2022-12-14_01:29:14.435415) 01:29:17.865162 run osmo-hlr_10.42.42.2(pid=24117): stderr: | [0;m[1;31m20221214012914611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012914611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012914611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012914611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012914611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012914611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012914623 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012914633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012914633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012914633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:29:17.917598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24106): Terminating (SIGTERM) 01:29:17.959308 run iperf3-srv_10.42.42.10(pid=24107): Terminating (SIGTERM) 01:29:18.002630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24108): Terminating (SIGTERM) 01:29:18.045879 run iperf3-srv_10.42.42.10(pid=24109): Terminating (SIGTERM) 01:29:18.088312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24110): Terminating (SIGTERM) 01:29:18.130763 run iperf3-srv_10.42.42.10(pid=24111): Terminating (SIGTERM) 01:29:18.174555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24112): Terminating (SIGTERM) 01:29:18.217377 run iperf3-srv_10.42.42.10(pid=24113): Terminating (SIGTERM) 01:29:18.259373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24116): Terminating (SIGTERM) 01:29:18.301822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24119): Terminating (SIGTERM) 01:29:18.344554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24122): Terminating (SIGTERM) 01:29:18.387358 --- ParallelTerminationStrategy: PID 24106 died... 01:29:18.407775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24106): Terminated: ok {rc=0} 01:29:18.454810 --- ParallelTerminationStrategy: PID 24107 died... 01:29:18.474998 run iperf3-srv_10.42.42.10(pid=24107): Terminated {rc=256} 01:29:18.521845 --- ParallelTerminationStrategy: PID 24108 died... 01:29:18.542358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24108): Terminated: ok {rc=0} 01:29:18.589079 --- ParallelTerminationStrategy: PID 24109 died... 01:29:18.609209 run iperf3-srv_10.42.42.10(pid=24109): Terminated {rc=256} 01:29:18.655992 --- ParallelTerminationStrategy: PID 24110 died... 01:29:18.676180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24110): Terminated: ok {rc=0} 01:29:18.722730 --- ParallelTerminationStrategy: PID 24111 died... 01:29:18.742965 run iperf3-srv_10.42.42.10(pid=24111): Terminated {rc=256} 01:29:18.789714 --- ParallelTerminationStrategy: PID 24112 died... 01:29:18.809876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24112): Terminated: ok {rc=0} 01:29:18.856422 --- ParallelTerminationStrategy: PID 24113 died... 01:29:18.876365 run iperf3-srv_10.42.42.10(pid=24113): Terminated {rc=256} 01:29:18.923109 --- ParallelTerminationStrategy: PID 24116 died... 01:29:18.943342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24116): Terminated: ok {rc=0} 01:29:18.990103 --- ParallelTerminationStrategy: PID 24119 died... 01:29:19.010298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24119): Terminated: ok {rc=0} 01:29:19.057189 --- ParallelTerminationStrategy: PID 24122 died... 01:29:19.077365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24122): Terminated: ok {rc=0} 01:29:19.166416 bus /gobi_4: Setting Powered False 01:29:20.264529 bus /gobi_4: Setting Powered False 01:29:21.380008 bus /gobi_1: Setting Powered False 01:29:22.478456 bus /gobi_1: Setting Powered False 01:29:23.593734 bus /gobi_0: Setting Powered False 01:29:24.691382 bus /gobi_0: Setting Powered False 01:29:25.808044 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms ping.py ---------------------------------------------- 01:29:26.910857 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:26.922781 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 01:29:26.977935 tst ping.py: using LAC 37601 01:29:27.106971 tst ping.py: using RAC 116 01:29:27.230019 tst ping.py: using CellId 37601 01:29:27.354369 tst ping.py: using BVCI 37602 01:29:27.469784 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:27.481055 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:27.492238 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:27.503334 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:27.515077 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:27.526419 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:27.537850 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:27.548685 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:29:27.663524 tst ping.py:19: start network... 01:29:27.861947 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:29:28.321184 run create_hlr_db(pid=24124): Launched 01:29:28.442646 bus /gobi_6: Setting Powered False 01:29:29.501926 run create_hlr_db(pid=24124): Terminated: ok {rc=0} 01:29:29.938563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24126): Launched 01:29:30.258669 run osmo-hlr_10.42.42.2(pid=24127): Launched 01:29:30.381444 run osmo-stp_10.42.42.5: Starting osmo-stp 01:29:30.945709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24129): Launched 01:29:31.273774 run osmo-stp_10.42.42.5(pid=24130): Launched 01:29:31.530587 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:29:32.199993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24132): Launched 01:29:32.328514 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:29:32.580543 run patchelf(pid=24133): Launched 01:29:32.745983 run osmo-stp_10.42.42.5(pid=24130): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24130)] 01:29:32.871980 run osmo-stp_10.42.42.5(pid=24130): stdout: | (launched: 2022-12-14_01:29:31.211412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:32.999929 run osmo-stp_10.42.42.5(pid=24130): stderr: | [0;m[38;5;43m20221214012931514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012931514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012931514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012931515 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012931515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012931515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012931515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:33.127596 run osmo-stp_10.42.42.5(pid=24130): stdout: | (launched: 2022-12-14_01:29:31.211412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:33.248556 run osmo-stp_10.42.42.5(pid=24130): stderr: | [0;m[38;5;43m20221214012931514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012931514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012931514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012931515 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012931515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012931515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012931515 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:33.393113 run patchelf(pid=24133): Terminating (SIGINT) 01:29:33.559251 run patchelf(pid=24133): Terminated: ok {rc=0} 01:29:33.679448 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24130): Process ended prematurely: osmo-stp_10.42.42.5(pid=24130) [trial-2397↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24130)] [trial-2397↪gprs:trx-lms↪ping.py:22] 01:29:33.688355 tst ping.py:22: Test FAILED (6.8 sec) 01:29:33.715048 run osmo-hlr_10.42.42.2(pid=24127): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24127)] 01:29:33.762232 run osmo-hlr_10.42.42.2(pid=24127): stdout: | (launched: 2022-12-14_01:29:30.199383) 01:29:33.811261 run osmo-hlr_10.42.42.2(pid=24127): stderr: | [0;m[1;31m20221214012930397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012930397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012930397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012930397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012930397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012930397 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012930408 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012930416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012930417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012930417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:29:33.861349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24126): Terminating (SIGTERM) 01:29:33.900887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24129): Terminating (SIGTERM) 01:29:33.940346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24132): Terminating (SIGTERM) 01:29:33.979969 --- ParallelTerminationStrategy: PID 24126 died... 01:29:33.999142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24126): Terminated: ok {rc=0} 01:29:34.042800 --- ParallelTerminationStrategy: PID 24129 died... 01:29:34.061426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24129): Terminated: ok {rc=0} 01:29:34.105063 --- ParallelTerminationStrategy: PID 24132 died... 01:29:34.123595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24132): Terminated: ok {rc=0} 01:29:34.209551 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 01:29:35.298456 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:35.310271 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 01:29:35.360902 tst ping_idle_ping.py: using LAC 37602 01:29:35.480578 tst ping_idle_ping.py: using RAC 117 01:29:35.600591 tst ping_idle_ping.py: using CellId 37602 01:29:35.719304 tst ping_idle_ping.py: using BVCI 37603 01:29:35.829522 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:35.840073 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:35.850637 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:35.861133 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:35.872053 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:35.883015 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:35.894180 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 01:29:35.905210 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 01:29:36.024663 tst ping_idle_ping.py:24: start network... 01:29:36.240850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:29:36.739430 run create_hlr_db(pid=24135): Launched 01:29:36.862584 bus /gobi_6: Setting Powered False 01:29:37.926560 run create_hlr_db(pid=24135): Terminated: ok {rc=0} 01:29:38.357585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24137): Launched 01:29:38.660152 run osmo-hlr_10.42.42.2(pid=24138): Launched 01:29:38.776709 run osmo-stp_10.42.42.5: Starting osmo-stp 01:29:39.292495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24140): Launched 01:29:39.592766 run osmo-stp_10.42.42.5(pid=24141): Launched 01:29:39.706587 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:29:40.220224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24143): Launched 01:29:40.335355 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:29:40.587965 run patchelf(pid=24144): Launched 01:29:40.755645 run osmo-stp_10.42.42.5(pid=24141): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24141)] 01:29:40.881207 run osmo-stp_10.42.42.5(pid=24141): stdout: | (launched: 2022-12-14_01:29:39.536814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:41.008382 run osmo-stp_10.42.42.5(pid=24141): stderr: | [0;m[38;5;43m20221214012939708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012939708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012939708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012939708 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012939709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012939709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012939709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:41.135738 run osmo-stp_10.42.42.5(pid=24141): stdout: | (launched: 2022-12-14_01:29:39.536814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:41.256549 run osmo-stp_10.42.42.5(pid=24141): stderr: | [0;m[38;5;43m20221214012939708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012939708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012939708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012939708 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012939709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012939709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012939709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:41.400150 run patchelf(pid=24144): Terminating (SIGINT) 01:29:41.566452 run patchelf(pid=24144): Terminated: ok {rc=0} 01:29:41.686580 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24141): Process ended prematurely: osmo-stp_10.42.42.5(pid=24141) [trial-2397↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24141)] [trial-2397↪gprs:trx-lms↪ping_idle_ping.py:27] 01:29:41.695440 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 01:29:41.722081 run osmo-hlr_10.42.42.2(pid=24138): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24138)] 01:29:41.769331 run osmo-hlr_10.42.42.2(pid=24138): stdout: | (launched: 2022-12-14_01:29:38.603833) 01:29:41.818401 run osmo-hlr_10.42.42.2(pid=24138): stderr: | [0;m[1;31m20221214012938779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012938779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012938779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012938779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012938779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012938779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012938791 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012938799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012938799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012938799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:29:41.867709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24137): Terminating (SIGTERM) 01:29:41.907174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24140): Terminating (SIGTERM) 01:29:41.946317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24143): Terminating (SIGTERM) 01:29:41.986349 --- ParallelTerminationStrategy: PID 24137 died... 01:29:42.005414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24137): Terminated: ok {rc=0} 01:29:42.049242 --- ParallelTerminationStrategy: PID 24140 died... 01:29:42.067761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24140): Terminated: ok {rc=0} 01:29:42.111177 --- ParallelTerminationStrategy: PID 24143 died... 01:29:42.129698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24143): Terminated: ok {rc=0} 01:29:42.212545 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 01:29:43.508211 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:29:43.513580 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:29:43.546206 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:29:43.584386 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:29:43.670238 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:29:43.702897 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:29:43.740869 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:29:44.333217 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:29:44.381935 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:44.392729 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:29:44.443313 tst cs_paging_gprs_active.py: using LAC 37603 01:29:44.563689 tst cs_paging_gprs_active.py: using RAC 118 01:29:44.681987 tst cs_paging_gprs_active.py: using CellId 37603 01:29:44.800431 tst cs_paging_gprs_active.py: using BVCI 37604 01:29:44.912168 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:44.923071 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:44.933723 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:44.944361 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:44.954937 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:44.965479 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:44.976198 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:44.986657 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:44.997438 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:29:45.118457 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:29:45.235208 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:29:45.439445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:45.746139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24149): Launched 01:29:46.022617 run iperf3-srv_10.42.42.10(pid=24150): Launched 01:29:46.153637 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:29:46.360759 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:46.675618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24151): Launched 01:29:46.998701 run iperf3-srv_10.42.42.10(pid=24152): Launched 01:29:47.139588 tst cs_paging_gprs_active.py:38: start network... 01:29:47.363422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:29:47.868804 run create_hlr_db(pid=24153): Launched 01:29:47.994979 bus /gobi_6: Setting Powered False 01:29:49.058667 run create_hlr_db(pid=24153): Terminated: ok {rc=0} 01:29:49.512291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24155): Launched 01:29:49.839065 run osmo-hlr_10.42.42.2(pid=24156): Launched 01:29:49.964207 run osmo-stp_10.42.42.5: Starting osmo-stp 01:29:50.529633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24158): Launched 01:29:50.858653 run osmo-stp_10.42.42.5(pid=24159): Launched 01:29:50.984141 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:29:51.546386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24161): Launched 01:29:51.671529 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:29:51.947359 run patchelf(pid=24162): Launched 01:29:52.130896 run osmo-stp_10.42.42.5(pid=24159): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24159)] 01:29:52.269090 run osmo-stp_10.42.42.5(pid=24159): stdout: | (launched: 2022-12-14_01:29:50.797663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:52.409132 run osmo-stp_10.42.42.5(pid=24159): stderr: | [0;m[38;5;43m20221214012950992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012950992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012950992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012950993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012950993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012950993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012950993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:52.548788 run osmo-stp_10.42.42.5(pid=24159): stdout: | (launched: 2022-12-14_01:29:50.797663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:29:52.682144 run osmo-stp_10.42.42.5(pid=24159): stderr: | [0;m[38;5;43m20221214012950992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214012950992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214012950992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214012950993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214012950993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214012950993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214012950993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:29:52.840086 run patchelf(pid=24162): Terminating (SIGINT) 01:29:53.022582 run patchelf(pid=24162): Terminated: ok {rc=0} 01:29:53.154096 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24159): Process ended prematurely: osmo-stp_10.42.42.5(pid=24159) [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24159)] [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:29:53.164485 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:29:53.193286 run osmo-hlr_10.42.42.2(pid=24156): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24156)] 01:29:53.244523 run osmo-hlr_10.42.42.2(pid=24156): stdout: | (launched: 2022-12-14_01:29:49.778824) 01:29:53.296740 run osmo-hlr_10.42.42.2(pid=24156): stderr: | [0;m[1;31m20221214012949979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214012949979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214012949979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214012949979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214012949979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214012949979 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214012949991 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214012949999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214012949999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214012949999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:29:53.349560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24149): Terminating (SIGTERM) 01:29:53.391513 run iperf3-srv_10.42.42.10(pid=24150): Terminating (SIGTERM) 01:29:53.433752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24151): Terminating (SIGTERM) 01:29:53.475938 run iperf3-srv_10.42.42.10(pid=24152): Terminating (SIGTERM) 01:29:53.517938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24155): Terminating (SIGTERM) 01:29:53.560366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24158): Terminating (SIGTERM) 01:29:53.602629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24161): Terminating (SIGTERM) 01:29:53.645079 --- ParallelTerminationStrategy: PID 24149 died... 01:29:53.665588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24149): Terminated: ok {rc=0} 01:29:53.712152 --- ParallelTerminationStrategy: PID 24150 died... 01:29:53.732010 run iperf3-srv_10.42.42.10(pid=24150): Terminated {rc=256} 01:29:53.778333 --- ParallelTerminationStrategy: PID 24151 died... 01:29:53.798425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24151): Terminated: ok {rc=0} 01:29:53.844740 --- ParallelTerminationStrategy: PID 24152 died... 01:29:53.864738 run iperf3-srv_10.42.42.10(pid=24152): Terminated {rc=256} 01:29:53.911262 --- ParallelTerminationStrategy: PID 24155 died... 01:29:53.931271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24155): Terminated: ok {rc=0} 01:29:53.977868 --- ParallelTerminationStrategy: PID 24158 died... 01:29:53.997933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24158): Terminated: ok {rc=0} 01:29:54.044347 --- ParallelTerminationStrategy: PID 24161 died... 01:29:54.064359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24161): Terminated: ok {rc=0} 01:29:54.152795 bus /gobi_0: Setting Powered False 01:29:55.252204 bus /gobi_0: Setting Powered False 01:29:56.368067 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:29:57.517544 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:57.529575 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:29:57.582549 tst iperf3.py: using LAC 37604 01:29:57.710138 tst iperf3.py: using RAC 119 01:29:57.839393 tst iperf3.py: using CellId 37604 01:29:57.966557 tst iperf3.py: using BVCI 37605 01:29:58.086781 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:58.098277 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:58.109430 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:58.120532 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:58.131968 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:58.143363 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:58.155008 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:58.166347 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:29:58.178005 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:29:58.293680 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:29:58.496568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:29:58.803885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24163): Launched 01:29:59.070050 run iperf3-srv_10.42.42.10(pid=24164): Launched 01:29:59.186198 tst iperf3.py:8: start network... 01:29:59.390083 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:29:59.861203 run create_hlr_db(pid=24165): Launched 01:29:59.986632 bus /gobi_6: Setting Powered False 01:30:01.058224 run create_hlr_db(pid=24165): Terminated: ok {rc=0} 01:30:01.533665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24170): Launched 01:30:01.890549 run osmo-hlr_10.42.42.2(pid=24171): Launched 01:30:02.037264 run osmo-stp_10.42.42.5: Starting osmo-stp 01:30:02.680006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24173): Launched 01:30:02.983420 run osmo-stp_10.42.42.5(pid=24174): Launched 01:30:03.097969 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:30:03.618483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24176): Launched 01:30:03.734151 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:30:03.990235 run patchelf(pid=24177): Launched 01:30:04.160006 run osmo-stp_10.42.42.5(pid=24174): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24174)] 01:30:04.287477 run osmo-stp_10.42.42.5(pid=24174): stdout: | (launched: 2022-12-14_01:30:02.927032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:04.417349 run osmo-stp_10.42.42.5(pid=24174): stderr: | [0;m[38;5;43m20221214013003100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013003100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013003100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013003101 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013003101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013003101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013003101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:04.547354 run osmo-stp_10.42.42.5(pid=24174): stdout: | (launched: 2022-12-14_01:30:02.927032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:04.671371 run osmo-stp_10.42.42.5(pid=24174): stderr: | [0;m[38;5;43m20221214013003100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013003100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013003100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013003101 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013003101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013003101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013003101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:04.817707 run patchelf(pid=24177): Terminating (SIGINT) 01:30:04.986344 run patchelf(pid=24177): Terminated: ok {rc=0} 01:30:05.108747 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24174): Process ended prematurely: osmo-stp_10.42.42.5(pid=24174) [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24174)] [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 01:30:05.118286 tst iperf3.py:8: Test FAILED (7.6 sec) 01:30:05.145247 run osmo-hlr_10.42.42.2(pid=24171): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24171)] 01:30:05.192362 run osmo-hlr_10.42.42.2(pid=24171): stdout: | (launched: 2022-12-14_01:30:01.831433) 01:30:05.241177 run osmo-hlr_10.42.42.2(pid=24171): stderr: | [0;m[1;31m20221214013002188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013002188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013002188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013002188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013002188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013002188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013002203 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013002222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013002222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013002222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:30:05.290796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24163): Terminating (SIGTERM) 01:30:05.329853 run iperf3-srv_10.42.42.10(pid=24164): Terminating (SIGTERM) 01:30:05.368807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24170): Terminating (SIGTERM) 01:30:05.407771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24173): Terminating (SIGTERM) 01:30:05.447015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24176): Terminating (SIGTERM) 01:30:05.486610 --- ParallelTerminationStrategy: PID 24163 died... 01:30:05.505824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24163): Terminated: ok {rc=0} 01:30:05.549503 --- ParallelTerminationStrategy: PID 24164 died... 01:30:05.567954 run iperf3-srv_10.42.42.10(pid=24164): Terminated {rc=256} 01:30:05.611531 --- ParallelTerminationStrategy: PID 24170 died... 01:30:05.630046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24170): Terminated: ok {rc=0} 01:30:05.673521 --- ParallelTerminationStrategy: PID 24173 died... 01:30:05.691775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24173): Terminated: ok {rc=0} 01:30:05.735203 --- ParallelTerminationStrategy: PID 24176 died... 01:30:05.753776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24176): Terminated: ok {rc=0} 01:30:05.839347 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:30:06.984790 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:06.996489 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:30:07.047099 tst iperf3m4.py: using LAC 37605 01:30:07.167515 tst iperf3m4.py: using RAC 120 01:30:07.286779 tst iperf3m4.py: using CellId 37605 01:30:07.415728 tst iperf3m4.py: using BVCI 37606 01:30:07.534324 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:07.545808 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:07.556786 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:07.568182 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:07.579550 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:07.590939 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:07.602473 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:07.613683 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:07.625221 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:30:07.743407 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:30:07.867547 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:30:07.987240 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:30:08.107325 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:30:08.326355 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:08.654422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24178): Launched 01:30:08.939513 run iperf3-srv_10.42.42.10(pid=24179): Launched 01:30:09.061403 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:30:09.280385 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:09.608783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24180): Launched 01:30:09.895586 run iperf3-srv_10.42.42.10(pid=24181): Launched 01:30:10.019204 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:30:10.237841 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:10.566480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24182): Launched 01:30:10.850893 run iperf3-srv_10.42.42.10(pid=24183): Launched 01:30:10.974256 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:30:11.193352 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:11.521639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24184): Launched 01:30:11.808008 run iperf3-srv_10.42.42.10(pid=24185): Launched 01:30:11.930844 tst iperf3m4.py:8: start network... 01:30:12.149666 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:30:12.653205 run create_hlr_db(pid=24186): Launched 01:30:12.776570 bus /gobi_6: Setting Powered False 01:30:13.841307 run create_hlr_db(pid=24186): Terminated: ok {rc=0} 01:30:14.275123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24188): Launched 01:30:14.579708 run osmo-hlr_10.42.42.2(pid=24189): Launched 01:30:14.697899 run osmo-stp_10.42.42.5: Starting osmo-stp 01:30:15.233566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24191): Launched 01:30:15.540232 run osmo-stp_10.42.42.5(pid=24192): Launched 01:30:15.656927 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:30:16.183661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24194): Launched 01:30:16.313978 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:30:16.574498 run patchelf(pid=24195): Launched 01:30:16.762729 run osmo-stp_10.42.42.5(pid=24192): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24192)] 01:30:16.893488 run osmo-stp_10.42.42.5(pid=24192): stdout: | (launched: 2022-12-14_01:30:15.483100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:17.027016 run osmo-stp_10.42.42.5(pid=24192): stderr: | [0;m[38;5;43m20221214013015653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013015654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013015654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013015654 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013015655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013015655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013015655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:17.159820 run osmo-stp_10.42.42.5(pid=24192): stdout: | (launched: 2022-12-14_01:30:15.483100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:17.284683 run osmo-stp_10.42.42.5(pid=24192): stderr: | [0;m[38;5;43m20221214013015653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013015654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013015654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013015654 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013015655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013015655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013015655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:17.431251 run patchelf(pid=24195): Terminating (SIGINT) 01:30:17.601330 run patchelf(pid=24195): Terminated: ok {rc=0} 01:30:17.724051 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24192): Process ended prematurely: osmo-stp_10.42.42.5(pid=24192) [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24192)] [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 01:30:17.733768 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:30:17.761459 run osmo-hlr_10.42.42.2(pid=24189): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24189)] 01:30:17.809322 run osmo-hlr_10.42.42.2(pid=24189): stdout: | (launched: 2022-12-14_01:30:14.522783) 01:30:17.858789 run osmo-hlr_10.42.42.2(pid=24189): stderr: | [0;m[1;31m20221214013014699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013014699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013014699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013014699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013014699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013014699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013014711 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013014722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013014722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013014722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:30:17.908485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24178): Terminating (SIGTERM) 01:30:17.948186 run iperf3-srv_10.42.42.10(pid=24179): Terminating (SIGTERM) 01:30:17.987802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24180): Terminating (SIGTERM) 01:30:18.027687 run iperf3-srv_10.42.42.10(pid=24181): Terminating (SIGTERM) 01:30:18.067495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24182): Terminating (SIGTERM) 01:30:18.107356 run iperf3-srv_10.42.42.10(pid=24183): Terminating (SIGTERM) 01:30:18.146992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24184): Terminating (SIGTERM) 01:30:18.186917 run iperf3-srv_10.42.42.10(pid=24185): Terminating (SIGTERM) 01:30:18.226692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24188): Terminating (SIGTERM) 01:30:18.266712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24191): Terminating (SIGTERM) 01:30:18.306726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24194): Terminating (SIGTERM) 01:30:18.346976 --- ParallelTerminationStrategy: PID 24178 died... 01:30:18.366084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24178): Terminated: ok {rc=0} 01:30:18.410275 --- ParallelTerminationStrategy: PID 24179 died... 01:30:18.428872 run iperf3-srv_10.42.42.10(pid=24179): Terminated {rc=256} 01:30:18.473055 --- ParallelTerminationStrategy: PID 24180 died... 01:30:18.491730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24180): Terminated: ok {rc=0} 01:30:18.535575 --- ParallelTerminationStrategy: PID 24181 died... 01:30:18.554420 run iperf3-srv_10.42.42.10(pid=24181): Terminated {rc=256} 01:30:18.598246 --- ParallelTerminationStrategy: PID 24182 died... 01:30:18.616914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24182): Terminated: ok {rc=0} 01:30:18.661322 --- ParallelTerminationStrategy: PID 24183 died... 01:30:18.680663 run iperf3-srv_10.42.42.10(pid=24183): Terminated {rc=256} 01:30:18.724832 --- ParallelTerminationStrategy: PID 24184 died... 01:30:18.744162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24184): Terminated: ok {rc=0} 01:30:18.788033 --- ParallelTerminationStrategy: PID 24185 died... 01:30:18.806905 run iperf3-srv_10.42.42.10(pid=24185): Terminated {rc=256} 01:30:18.850786 --- ParallelTerminationStrategy: PID 24188 died... 01:30:18.870120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24188): Terminated: ok {rc=0} 01:30:18.914213 --- ParallelTerminationStrategy: PID 24191 died... 01:30:18.932847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24191): Terminated: ok {rc=0} 01:30:18.977301 --- ParallelTerminationStrategy: PID 24194 died... 01:30:18.995778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24194): Terminated: ok {rc=0} 01:30:19.081322 bus /gobi_4: Setting Powered False 01:30:20.180586 bus /gobi_4: Setting Powered False 01:30:21.297036 bus /gobi_1: Setting Powered False 01:30:22.396267 bus /gobi_1: Setting Powered False 01:30:23.507822 bus /gobi_0: Setting Powered False 01:30:24.605332 bus /gobi_0: Setting Powered False 01:30:25.720647 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 01:30:26.822035 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:26.834049 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:30:26.886225 tst ping.py: using LAC 37606 01:30:27.012284 tst ping.py: using RAC 121 01:30:27.136061 tst ping.py: using CellId 37606 01:30:27.265193 tst ping.py: using BVCI 37607 01:30:27.381833 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:27.393683 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:27.404744 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:27.415932 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:27.427372 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:27.438958 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:27.450599 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:27.462039 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:30:27.576342 tst ping.py:19: start network... 01:30:27.775525 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:30:28.235212 run create_hlr_db(pid=24196): Launched 01:30:28.361707 bus /gobi_6: Setting Powered False 01:30:29.424914 run create_hlr_db(pid=24196): Terminated: ok {rc=0} 01:30:29.851376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24198): Launched 01:30:30.149950 run osmo-hlr_10.42.42.2(pid=24199): Launched 01:30:30.263768 run osmo-stp_10.42.42.5: Starting osmo-stp 01:30:30.777680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24201): Launched 01:30:31.084293 run osmo-stp_10.42.42.5(pid=24202): Launched 01:30:31.307435 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:30:32.081714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24204): Launched 01:30:32.214915 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:30:32.491938 run patchelf(pid=24205): Launched 01:30:32.670704 run osmo-stp_10.42.42.5(pid=24202): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24202)] 01:30:32.805738 run osmo-stp_10.42.42.5(pid=24202): stdout: | (launched: 2022-12-14_01:30:31.028023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:32.943049 run osmo-stp_10.42.42.5(pid=24202): stderr: | [0;m[38;5;43m20221214013031415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013031415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013031418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013031419 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013031420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013031420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013031421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:33.079927 run osmo-stp_10.42.42.5(pid=24202): stdout: | (launched: 2022-12-14_01:30:31.028023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:33.210751 run osmo-stp_10.42.42.5(pid=24202): stderr: | [0;m[38;5;43m20221214013031415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013031415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013031418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013031419 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013031420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013031420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013031421 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:33.365116 run patchelf(pid=24205): Terminating (SIGINT) 01:30:33.543328 run patchelf(pid=24205): Terminated: ok {rc=0} 01:30:33.671158 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24202): Process ended prematurely: osmo-stp_10.42.42.5(pid=24202) [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24202)] [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 01:30:33.680731 tst ping.py:22: Test FAILED (6.9 sec) 01:30:33.709104 run osmo-hlr_10.42.42.2(pid=24199): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24199)] 01:30:33.759781 run osmo-hlr_10.42.42.2(pid=24199): stdout: | (launched: 2022-12-14_01:30:30.094181) 01:30:33.812161 run osmo-hlr_10.42.42.2(pid=24199): stderr: | [0;m[1;31m20221214013030269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013030269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013030269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013030269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013030269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013030269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013030281 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013030290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013030290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013030290 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:30:33.864667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24198): Terminating (SIGTERM) 01:30:33.906308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24201): Terminating (SIGTERM) 01:30:33.948396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24204): Terminating (SIGTERM) 01:30:33.991250 --- ParallelTerminationStrategy: PID 24198 died... 01:30:34.011667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24198): Terminated: ok {rc=0} 01:30:34.058291 --- ParallelTerminationStrategy: PID 24201 died... 01:30:34.078197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24201): Terminated: ok {rc=0} 01:30:34.124474 --- ParallelTerminationStrategy: PID 24204 died... 01:30:34.144494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24204): Terminated: ok {rc=0} 01:30:34.233702 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:30:35.321446 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:35.333571 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:30:35.389776 tst ping_idle_ping.py: using LAC 37607 01:30:35.515069 tst ping_idle_ping.py: using RAC 122 01:30:35.638250 tst ping_idle_ping.py: using CellId 37607 01:30:35.760884 tst ping_idle_ping.py: using BVCI 37608 01:30:35.877073 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:35.888496 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:35.899764 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:35.911033 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:35.922477 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:35.933977 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:35.945695 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:30:35.957116 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:30:36.073313 tst ping_idle_ping.py:24: start network... 01:30:36.272922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:30:36.736344 run create_hlr_db(pid=24206): Launched 01:30:36.859955 bus /gobi_6: Setting Powered False 01:30:37.920554 run create_hlr_db(pid=24206): Terminated: ok {rc=0} 01:30:38.359413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24208): Launched 01:30:38.681079 run osmo-hlr_10.42.42.2(pid=24209): Launched 01:30:38.804306 run osmo-stp_10.42.42.5: Starting osmo-stp 01:30:39.353890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24211): Launched 01:30:39.678513 run osmo-stp_10.42.42.5(pid=24212): Launched 01:30:39.801488 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:30:40.352862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24214): Launched 01:30:40.477835 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:30:40.748462 run patchelf(pid=24215): Launched 01:30:40.927862 run osmo-stp_10.42.42.5(pid=24212): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24212)] 01:30:41.062710 run osmo-stp_10.42.42.5(pid=24212): stdout: | (launched: 2022-12-14_01:30:39.618451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:41.199755 run osmo-stp_10.42.42.5(pid=24212): stderr: | [0;m[38;5;43m20221214013039811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013039811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013039811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013039812 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013039812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013039812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013039812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:41.337103 run osmo-stp_10.42.42.5(pid=24212): stdout: | (launched: 2022-12-14_01:30:39.618451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:41.467941 run osmo-stp_10.42.42.5(pid=24212): stderr: | [0;m[38;5;43m20221214013039811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013039811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013039811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013039812 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013039812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013039812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013039812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:41.623239 run patchelf(pid=24215): Terminating (SIGINT) 01:30:41.801485 run patchelf(pid=24215): Terminated: ok {rc=0} 01:30:41.930228 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24212): Process ended prematurely: osmo-stp_10.42.42.5(pid=24212) [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24212)] [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 01:30:41.939716 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 01:30:41.967939 run osmo-hlr_10.42.42.2(pid=24209): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24209)] 01:30:42.018559 run osmo-hlr_10.42.42.2(pid=24209): stdout: | (launched: 2022-12-14_01:30:38.621418) 01:30:42.071122 run osmo-hlr_10.42.42.2(pid=24209): stderr: | [0;m[1;31m20221214013038819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013038819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013038819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013038819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013038819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013038819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013038832 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013038840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013038840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013038840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:30:42.123430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24208): Terminating (SIGTERM) 01:30:42.165211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24211): Terminating (SIGTERM) 01:30:42.207702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24214): Terminating (SIGTERM) 01:30:42.250271 --- ParallelTerminationStrategy: PID 24208 died... 01:30:42.270600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24208): Terminated: ok {rc=0} 01:30:42.317192 --- ParallelTerminationStrategy: PID 24211 died... 01:30:42.337254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24211): Terminated: ok {rc=0} 01:30:42.383720 --- ParallelTerminationStrategy: PID 24214 died... 01:30:42.403986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24214): Terminated: ok {rc=0} 01:30:42.492017 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:30:43.808144 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:30:43.815514 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:30:43.848596 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:30:43.887026 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:30:43.979426 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:30:44.012421 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:30:44.050544 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:30:44.637912 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:30:44.686668 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:44.697590 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:30:44.765171 tst cs_paging_gprs_active.py: using LAC 37608 01:30:44.885480 tst cs_paging_gprs_active.py: using RAC 123 01:30:45.004295 tst cs_paging_gprs_active.py: using CellId 37608 01:30:45.121908 tst cs_paging_gprs_active.py: using BVCI 37609 01:30:45.231617 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:45.242590 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:45.253357 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:45.263987 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:45.274657 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:45.285426 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:45.296145 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:45.306664 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:45.317907 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:30:45.438887 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:30:45.555800 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:30:45.759433 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:46.124402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24221): Launched 01:30:46.437800 run iperf3-srv_10.42.42.10(pid=24222): Launched 01:30:46.554666 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:30:46.763016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:47.076487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24223): Launched 01:30:47.398446 run iperf3-srv_10.42.42.10(pid=24224): Launched 01:30:47.520810 tst cs_paging_gprs_active.py:38: start network... 01:30:47.740345 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:30:48.244219 run create_hlr_db(pid=24225): Launched 01:30:48.369564 bus /gobi_6: Setting Powered False 01:30:49.434638 run create_hlr_db(pid=24225): Terminated: ok {rc=0} 01:30:49.888068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24227): Launched 01:30:50.214992 run osmo-hlr_10.42.42.2(pid=24228): Launched 01:30:50.341641 run osmo-stp_10.42.42.5: Starting osmo-stp 01:30:50.904032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24230): Launched 01:30:51.231223 run osmo-stp_10.42.42.5(pid=24231): Launched 01:30:51.357011 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:30:51.921300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24233): Launched 01:30:52.044331 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:30:52.310152 run patchelf(pid=24235): Launched 01:30:52.480515 run osmo-stp_10.42.42.5(pid=24231): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24231)] 01:30:52.608828 run osmo-stp_10.42.42.5(pid=24231): stdout: | (launched: 2022-12-14_01:30:51.170854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:52.738547 run osmo-stp_10.42.42.5(pid=24231): stderr: | [0;m[38;5;43m20221214013051364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013051364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013051364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013051365 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013051365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013051365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013051365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:52.868239 run osmo-stp_10.42.42.5(pid=24231): stdout: | (launched: 2022-12-14_01:30:51.170854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:30:52.992788 run osmo-stp_10.42.42.5(pid=24231): stderr: | [0;m[38;5;43m20221214013051364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013051364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013051364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013051365 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013051365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013051365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013051365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:30:53.139851 run patchelf(pid=24235): Terminating (SIGINT) 01:30:53.310638 run patchelf(pid=24235): Terminated: ok {rc=0} 01:30:53.433524 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24231): Process ended prematurely: osmo-stp_10.42.42.5(pid=24231) [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24231)] [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:30:53.442853 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:30:53.469856 run osmo-hlr_10.42.42.2(pid=24228): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24228)] 01:30:53.516862 run osmo-hlr_10.42.42.2(pid=24228): stdout: | (launched: 2022-12-14_01:30:50.154685) 01:30:53.565609 run osmo-hlr_10.42.42.2(pid=24228): stderr: | [0;m[1;31m20221214013050353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013050353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013050353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013050353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013050353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013050353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013050365 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013050373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013050374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013050374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:30:53.614725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24221): Terminating (SIGTERM) 01:30:53.653829 run iperf3-srv_10.42.42.10(pid=24222): Terminating (SIGTERM) 01:30:53.693075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24223): Terminating (SIGTERM) 01:30:53.732222 run iperf3-srv_10.42.42.10(pid=24224): Terminating (SIGTERM) 01:30:53.771282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24227): Terminating (SIGTERM) 01:30:53.810530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24230): Terminating (SIGTERM) 01:30:53.849515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24233): Terminating (SIGTERM) 01:30:53.889492 --- ParallelTerminationStrategy: PID 24221 died... 01:30:53.908387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24221): Terminated: ok {rc=0} 01:30:53.951780 --- ParallelTerminationStrategy: PID 24222 died... 01:30:53.970178 run iperf3-srv_10.42.42.10(pid=24222): Terminated {rc=256} 01:30:54.013335 --- ParallelTerminationStrategy: PID 24223 died... 01:30:54.031722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24223): Terminated: ok {rc=0} 01:30:54.074875 --- ParallelTerminationStrategy: PID 24224 died... 01:30:54.093453 run iperf3-srv_10.42.42.10(pid=24224): Terminated {rc=256} 01:30:54.136492 --- ParallelTerminationStrategy: PID 24227 died... 01:30:54.155056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24227): Terminated: ok {rc=0} 01:30:54.198232 --- ParallelTerminationStrategy: PID 24230 died... 01:30:54.216766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24230): Terminated: ok {rc=0} 01:30:54.259813 --- ParallelTerminationStrategy: PID 24233 died... 01:30:54.278255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24233): Terminated: ok {rc=0} 01:30:54.363083 bus /gobi_0: Setting Powered False 01:30:55.462852 bus /gobi_0: Setting Powered False 01:30:56.576063 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:30:57.725718 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:57.737936 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:30:57.809955 tst iperf3.py: using LAC 37609 01:30:57.942195 tst iperf3.py: using RAC 124 01:30:58.061632 tst iperf3.py: using CellId 37609 01:30:58.188001 tst iperf3.py: using BVCI 37610 01:30:58.307654 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:58.319069 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:58.330251 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:58.341467 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:58.352922 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:58.364375 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:58.375879 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:58.387219 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:30:58.399184 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:30:58.515339 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:30:58.719525 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:30:59.027183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24236): Launched 01:30:59.296562 run iperf3-srv_10.42.42.10(pid=24237): Launched 01:30:59.410322 tst iperf3.py:8: start network... 01:30:59.612407 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:31:00.084132 run create_hlr_db(pid=24238): Launched 01:31:00.209970 bus /gobi_6: Setting Powered False 01:31:01.269278 run create_hlr_db(pid=24238): Terminated: ok {rc=0} 01:31:01.704236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24240): Launched 01:31:02.025481 run osmo-hlr_10.42.42.2(pid=24241): Launched 01:31:02.235501 run osmo-stp_10.42.42.5: Starting osmo-stp 01:31:02.777359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24243): Launched 01:31:03.084081 run osmo-stp_10.42.42.5(pid=24244): Launched 01:31:03.200516 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:31:03.724211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24246): Launched 01:31:03.842055 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:31:04.098441 run patchelf(pid=24247): Launched 01:31:04.268324 run osmo-stp_10.42.42.5(pid=24244): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24244)] 01:31:04.396476 run osmo-stp_10.42.42.5(pid=24244): stdout: | (launched: 2022-12-14_01:31:03.026479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:04.526943 run osmo-stp_10.42.42.5(pid=24244): stderr: | [0;m[38;5;43m20221214013103197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013103197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013103198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013103198 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013103199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013103199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013103199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:04.657131 run osmo-stp_10.42.42.5(pid=24244): stdout: | (launched: 2022-12-14_01:31:03.026479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:04.780139 run osmo-stp_10.42.42.5(pid=24244): stderr: | [0;m[38;5;43m20221214013103197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013103197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013103198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013103198 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013103199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013103199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013103199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:04.926666 run patchelf(pid=24247): Terminating (SIGINT) 01:31:05.096468 run patchelf(pid=24247): Terminated: ok {rc=0} 01:31:05.219524 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24244): Process ended prematurely: osmo-stp_10.42.42.5(pid=24244) [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24244)] [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 01:31:05.228916 tst iperf3.py:8: Test FAILED (7.5 sec) 01:31:05.256138 run osmo-hlr_10.42.42.2(pid=24241): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24241)] 01:31:05.303509 run osmo-hlr_10.42.42.2(pid=24241): stdout: | (launched: 2022-12-14_01:31:01.967554) 01:31:05.352468 run osmo-hlr_10.42.42.2(pid=24241): stderr: | [0;m[1;31m20221214013102218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013102219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013102219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013102219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013102219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013102219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013102231 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013102239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013102239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013102239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:31:05.402062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24236): Terminating (SIGTERM) 01:31:05.441754 run iperf3-srv_10.42.42.10(pid=24237): Terminating (SIGTERM) 01:31:05.481278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24240): Terminating (SIGTERM) 01:31:05.521477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24243): Terminating (SIGTERM) 01:31:05.560773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24246): Terminating (SIGTERM) 01:31:05.600579 --- ParallelTerminationStrategy: PID 24236 died... 01:31:05.619834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24236): Terminated: ok {rc=0} 01:31:05.663634 --- ParallelTerminationStrategy: PID 24237 died... 01:31:05.682221 run iperf3-srv_10.42.42.10(pid=24237): Terminated {rc=256} 01:31:05.725486 --- ParallelTerminationStrategy: PID 24240 died... 01:31:05.743976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24240): Terminated: ok {rc=0} 01:31:05.787216 --- ParallelTerminationStrategy: PID 24243 died... 01:31:05.805829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24243): Terminated: ok {rc=0} 01:31:05.849287 --- ParallelTerminationStrategy: PID 24246 died... 01:31:05.867985 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24246): Terminated: ok {rc=0} 01:31:05.954394 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:31:07.102010 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:07.113756 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:31:07.184356 tst iperf3m4.py: using LAC 37610 01:31:07.303473 tst iperf3m4.py: using RAC 125 01:31:07.424195 tst iperf3m4.py: using CellId 37610 01:31:07.542665 tst iperf3m4.py: using BVCI 37611 01:31:07.652246 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:07.663205 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:07.673966 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:07.684697 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:07.695387 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:07.706105 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:07.716853 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:07.727470 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:07.738401 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:31:07.858844 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:31:07.982043 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:31:08.099750 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:31:08.219956 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:31:08.439304 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:08.766425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24248): Launched 01:31:09.050353 run iperf3-srv_10.42.42.10(pid=24249): Launched 01:31:09.174582 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:31:09.393061 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:09.720614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24250): Launched 01:31:10.005036 run iperf3-srv_10.42.42.10(pid=24251): Launched 01:31:10.127747 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:31:10.345683 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:10.672143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24252): Launched 01:31:10.957721 run iperf3-srv_10.42.42.10(pid=24253): Launched 01:31:11.079333 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:31:11.298297 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:11.626813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24254): Launched 01:31:11.910779 run iperf3-srv_10.42.42.10(pid=24255): Launched 01:31:12.034050 tst iperf3m4.py:8: start network... 01:31:12.251728 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:31:12.756664 run create_hlr_db(pid=24256): Launched 01:31:12.881688 bus /gobi_6: Setting Powered False 01:31:13.945860 run create_hlr_db(pid=24256): Terminated: ok {rc=0} 01:31:14.397902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24258): Launched 01:31:14.723124 run osmo-hlr_10.42.42.2(pid=24259): Launched 01:31:14.848512 run osmo-stp_10.42.42.5: Starting osmo-stp 01:31:15.411096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24261): Launched 01:31:15.737986 run osmo-stp_10.42.42.5(pid=24262): Launched 01:31:15.915781 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:31:16.538741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24264): Launched 01:31:16.670185 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:31:16.933091 run patchelf(pid=24265): Launched 01:31:17.120628 run osmo-stp_10.42.42.5(pid=24262): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24262)] 01:31:17.252875 run osmo-stp_10.42.42.5(pid=24262): stdout: | (launched: 2022-12-14_01:31:15.677368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:17.385288 run osmo-stp_10.42.42.5(pid=24262): stderr: | [0;m[38;5;43m20221214013115900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013115900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013115900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013115901 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013115901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013115901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013115901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:17.514996 run osmo-stp_10.42.42.5(pid=24262): stdout: | (launched: 2022-12-14_01:31:15.677368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:17.638348 run osmo-stp_10.42.42.5(pid=24262): stderr: | [0;m[38;5;43m20221214013115900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013115900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013115900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013115901 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013115901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013115901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013115901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:17.784134 run patchelf(pid=24265): Terminating (SIGINT) 01:31:17.953300 run patchelf(pid=24265): Terminated: ok {rc=0} 01:31:18.075435 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24262): Process ended prematurely: osmo-stp_10.42.42.5(pid=24262) [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24262)] [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:31:18.084866 tst iperf3m4.py:8: Test FAILED (11.0 sec) 01:31:18.112405 run osmo-hlr_10.42.42.2(pid=24259): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24259)] 01:31:18.159697 run osmo-hlr_10.42.42.2(pid=24259): stdout: | (launched: 2022-12-14_01:31:14.662515) 01:31:18.208860 run osmo-hlr_10.42.42.2(pid=24259): stderr: | [0;m[1;31m20221214013114862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013114862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013114862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013114862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013114862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013114862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013114874 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013114883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013114883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013114883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:31:18.258473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24248): Terminating (SIGTERM) 01:31:18.298086 run iperf3-srv_10.42.42.10(pid=24249): Terminating (SIGTERM) 01:31:18.337505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24250): Terminating (SIGTERM) 01:31:18.377058 run iperf3-srv_10.42.42.10(pid=24251): Terminating (SIGTERM) 01:31:18.416159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24252): Terminating (SIGTERM) 01:31:18.455515 run iperf3-srv_10.42.42.10(pid=24253): Terminating (SIGTERM) 01:31:18.494741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24254): Terminating (SIGTERM) 01:31:18.534019 run iperf3-srv_10.42.42.10(pid=24255): Terminating (SIGTERM) 01:31:18.573200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24258): Terminating (SIGTERM) 01:31:18.612733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24261): Terminating (SIGTERM) 01:31:18.652316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24264): Terminating (SIGTERM) 01:31:18.692000 --- ParallelTerminationStrategy: PID 24248 died... 01:31:18.711207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24248): Terminated: ok {rc=0} 01:31:18.755233 --- ParallelTerminationStrategy: PID 24249 died... 01:31:18.773917 run iperf3-srv_10.42.42.10(pid=24249): Terminated {rc=256} 01:31:18.817619 --- ParallelTerminationStrategy: PID 24250 died... 01:31:18.836391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24250): Terminated: ok {rc=0} 01:31:18.880054 --- ParallelTerminationStrategy: PID 24251 died... 01:31:18.898589 run iperf3-srv_10.42.42.10(pid=24251): Terminated {rc=256} 01:31:18.942222 --- ParallelTerminationStrategy: PID 24252 died... 01:31:18.961190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24252): Terminated: ok {rc=0} 01:31:19.005100 --- ParallelTerminationStrategy: PID 24253 died... 01:31:19.023650 run iperf3-srv_10.42.42.10(pid=24253): Terminated {rc=256} 01:31:19.067272 --- ParallelTerminationStrategy: PID 24254 died... 01:31:19.086023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24254): Terminated: ok {rc=0} 01:31:19.129729 --- ParallelTerminationStrategy: PID 24255 died... 01:31:19.148850 run iperf3-srv_10.42.42.10(pid=24255): Terminated {rc=256} 01:31:19.192771 --- ParallelTerminationStrategy: PID 24258 died... 01:31:19.211520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24258): Terminated: ok {rc=0} 01:31:19.255391 --- ParallelTerminationStrategy: PID 24261 died... 01:31:19.274181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24261): Terminated: ok {rc=0} 01:31:19.317930 --- ParallelTerminationStrategy: PID 24264 died... 01:31:19.336786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24264): Terminated: ok {rc=0} 01:31:19.423348 bus /gobi_4: Setting Powered False 01:31:20.523146 bus /gobi_4: Setting Powered False 01:31:21.636552 bus /gobi_1: Setting Powered False 01:31:22.730873 bus /gobi_1: Setting Powered False 01:31:23.846039 bus /gobi_0: Setting Powered False 01:31:24.945039 bus /gobi_0: Setting Powered False 01:31:26.060437 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:31:27.164080 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:27.175673 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:31:27.245501 tst ping.py: using LAC 37611 01:31:27.363903 tst ping.py: using RAC 126 01:31:27.481703 tst ping.py: using CellId 37611 01:31:27.597911 tst ping.py: using BVCI 37612 01:31:27.705162 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:27.715977 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:27.726671 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:27.737397 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:27.747943 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:27.758757 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:27.769546 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:27.780132 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:31:27.894219 tst ping.py:19: start network... 01:31:28.092786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:31:28.553633 run create_hlr_db(pid=24266): Launched 01:31:28.676855 bus /gobi_6: Setting Powered False 01:31:29.736842 run create_hlr_db(pid=24266): Terminated: ok {rc=0} 01:31:30.175534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24268): Launched 01:31:30.498136 run osmo-hlr_10.42.42.2(pid=24269): Launched 01:31:30.622219 run osmo-stp_10.42.42.5: Starting osmo-stp 01:31:31.217797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24271): Launched 01:31:31.537754 run osmo-stp_10.42.42.5(pid=24272): Launched 01:31:31.698175 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:31:32.376926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24274): Launched 01:31:32.491406 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:31:32.743504 run patchelf(pid=24275): Launched 01:31:32.910289 run osmo-stp_10.42.42.5(pid=24272): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24272)] 01:31:33.035847 run osmo-stp_10.42.42.5(pid=24272): stdout: | (launched: 2022-12-14_01:31:31.480302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:33.163340 run osmo-stp_10.42.42.5(pid=24272): stderr: | [0;m[38;5;43m20221214013131766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013131766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013131767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013131767 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013131768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013131768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013131768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:33.291460 run osmo-stp_10.42.42.5(pid=24272): stdout: | (launched: 2022-12-14_01:31:31.480302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:33.413304 run osmo-stp_10.42.42.5(pid=24272): stderr: | [0;m[38;5;43m20221214013131766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013131766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013131767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013131767 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013131768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013131768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013131768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:33.556776 run patchelf(pid=24275): Terminating (SIGINT) 01:31:33.723006 run patchelf(pid=24275): Terminated: ok {rc=0} 01:31:33.842847 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24272): Process ended prematurely: osmo-stp_10.42.42.5(pid=24272) [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24272)] [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 01:31:33.851818 tst ping.py:22: Test FAILED (6.7 sec) 01:31:33.878418 run osmo-hlr_10.42.42.2(pid=24269): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24269)] 01:31:33.925576 run osmo-hlr_10.42.42.2(pid=24269): stdout: | (launched: 2022-12-14_01:31:30.438167) 01:31:33.974388 run osmo-hlr_10.42.42.2(pid=24269): stderr: | [0;m[1;31m20221214013130636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013130636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013130636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013130636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013130636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013130636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013130649 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013130658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013130658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013130658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:31:34.023832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24268): Terminating (SIGTERM) 01:31:34.063641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24271): Terminating (SIGTERM) 01:31:34.103165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24274): Terminating (SIGTERM) 01:31:34.142830 --- ParallelTerminationStrategy: PID 24268 died... 01:31:34.161951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24268): Terminated: ok {rc=0} 01:31:34.205714 --- ParallelTerminationStrategy: PID 24271 died... 01:31:34.224344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24271): Terminated: ok {rc=0} 01:31:34.268343 --- ParallelTerminationStrategy: PID 24274 died... 01:31:34.287020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24274): Terminated: ok {rc=0} 01:31:34.372179 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:31:35.462013 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:35.474105 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:31:35.545596 tst ping_idle_ping.py: using LAC 37612 01:31:35.675059 tst ping_idle_ping.py: using RAC 127 01:31:35.802407 tst ping_idle_ping.py: using CellId 37612 01:31:35.933194 tst ping_idle_ping.py: using BVCI 37613 01:31:36.050333 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:36.061985 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:36.073471 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:36.084765 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:36.097149 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:36.109569 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:36.122110 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:31:36.134313 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:31:36.250892 tst ping_idle_ping.py:24: start network... 01:31:36.451440 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:31:36.917459 run create_hlr_db(pid=24276): Launched 01:31:37.045665 bus /gobi_6: Setting Powered False 01:31:38.110250 run create_hlr_db(pid=24276): Terminated: ok {rc=0} 01:31:38.559709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24278): Launched 01:31:38.883214 run osmo-hlr_10.42.42.2(pid=24279): Launched 01:31:39.005499 run osmo-stp_10.42.42.5: Starting osmo-stp 01:31:39.555665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24281): Launched 01:31:39.878629 run osmo-stp_10.42.42.5(pid=24282): Launched 01:31:40.004384 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:31:40.558579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24284): Launched 01:31:40.683225 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:31:40.954830 run patchelf(pid=24285): Launched 01:31:41.134535 run osmo-stp_10.42.42.5(pid=24282): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24282)] 01:31:41.270059 run osmo-stp_10.42.42.5(pid=24282): stdout: | (launched: 2022-12-14_01:31:39.818491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:41.407799 run osmo-stp_10.42.42.5(pid=24282): stderr: | [0;m[38;5;43m20221214013140010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013140010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013140010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013140011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013140011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013140011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013140011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:41.546628 run osmo-stp_10.42.42.5(pid=24282): stdout: | (launched: 2022-12-14_01:31:39.818491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:41.677609 run osmo-stp_10.42.42.5(pid=24282): stderr: | [0;m[38;5;43m20221214013140010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013140010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013140010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013140011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013140011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013140011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013140011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:41.833353 run patchelf(pid=24285): Terminating (SIGINT) 01:31:42.012278 run patchelf(pid=24285): Terminated: ok {rc=0} 01:31:42.141394 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24282): Process ended prematurely: osmo-stp_10.42.42.5(pid=24282) [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24282)] [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:31:42.150956 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:31:42.179161 run osmo-hlr_10.42.42.2(pid=24279): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24279)] 01:31:42.229832 run osmo-hlr_10.42.42.2(pid=24279): stdout: | (launched: 2022-12-14_01:31:38.823601) 01:31:42.282139 run osmo-hlr_10.42.42.2(pid=24279): stderr: | [0;m[1;31m20221214013139020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013139020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013139020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013139020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013139020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013139021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013139033 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013139041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013139041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013139041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:31:42.334778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24278): Terminating (SIGTERM) 01:31:42.376590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24281): Terminating (SIGTERM) 01:31:42.419621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24284): Terminating (SIGTERM) 01:31:42.462182 --- ParallelTerminationStrategy: PID 24278 died... 01:31:42.482771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24278): Terminated: ok {rc=0} 01:31:42.529393 --- ParallelTerminationStrategy: PID 24281 died... 01:31:42.549335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24281): Terminated: ok {rc=0} 01:31:42.595673 --- ParallelTerminationStrategy: PID 24284 died... 01:31:42.615641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24284): Terminated: ok {rc=0} 01:31:42.702901 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:31:44.006558 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:31:44.012515 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:31:44.044997 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 01:31:44.083037 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 01:31:44.168832 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:31:44.201887 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 01:31:44.239761 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 01:31:44.833363 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 01:31:44.881807 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:44.892592 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:31:44.962294 tst cs_paging_gprs_active.py: using LAC 37613 01:31:45.083303 tst cs_paging_gprs_active.py: using RAC 128 01:31:45.203758 tst cs_paging_gprs_active.py: using CellId 37613 01:31:45.334354 tst cs_paging_gprs_active.py: using BVCI 37614 01:31:45.455268 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:45.466889 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:45.478397 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:45.489935 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:45.501918 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:45.513822 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:45.525643 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:45.537175 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:45.548835 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:31:45.666558 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:31:45.786123 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:31:45.992465 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:46.304918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24290): Launched 01:31:46.590078 run iperf3-srv_10.42.42.10(pid=24291): Launched 01:31:46.720623 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:31:46.928805 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:47.241402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24292): Launched 01:31:47.533982 run iperf3-srv_10.42.42.10(pid=24293): Launched 01:31:47.656836 tst cs_paging_gprs_active.py:38: start network... 01:31:47.877752 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:31:48.385552 run create_hlr_db(pid=24294): Launched 01:31:48.513147 bus /gobi_6: Setting Powered False 01:31:49.577738 run create_hlr_db(pid=24294): Terminated: ok {rc=0} 01:31:50.015017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24296): Launched 01:31:50.318976 run osmo-hlr_10.42.42.2(pid=24297): Launched 01:31:50.435796 run osmo-stp_10.42.42.5: Starting osmo-stp 01:31:50.965360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24299): Launched 01:31:51.270489 run osmo-stp_10.42.42.5(pid=24300): Launched 01:31:51.387692 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:31:51.912337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24302): Launched 01:31:52.028323 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:31:52.285687 run patchelf(pid=24303): Launched 01:31:52.456907 run osmo-stp_10.42.42.5(pid=24300): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24300)] 01:31:52.585861 run osmo-stp_10.42.42.5(pid=24300): stdout: | (launched: 2022-12-14_01:31:51.213566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:52.716275 run osmo-stp_10.42.42.5(pid=24300): stderr: | [0;m[38;5;43m20221214013151384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013151384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013151384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013151385 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013151385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013151385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013151385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:52.846685 run osmo-stp_10.42.42.5(pid=24300): stdout: | (launched: 2022-12-14_01:31:51.213566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:31:52.971182 run osmo-stp_10.42.42.5(pid=24300): stderr: | [0;m[38;5;43m20221214013151384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013151384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013151384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013151385 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013151385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013151385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013151385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:31:53.118236 run patchelf(pid=24303): Terminating (SIGINT) 01:31:53.289216 run patchelf(pid=24303): Terminated: ok {rc=0} 01:31:53.412154 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24300): Process ended prematurely: osmo-stp_10.42.42.5(pid=24300) [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24300)] [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 01:31:53.422147 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 01:31:53.449277 run osmo-hlr_10.42.42.2(pid=24297): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24297)] 01:31:53.496122 run osmo-hlr_10.42.42.2(pid=24297): stdout: | (launched: 2022-12-14_01:31:50.262328) 01:31:53.544489 run osmo-hlr_10.42.42.2(pid=24297): stderr: | [0;m[1;31m20221214013150437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013150437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013150437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013150437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013150437 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013150438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013150450 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013150459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013150459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013150459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:31:53.593554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24290): Terminating (SIGTERM) 01:31:53.632400 run iperf3-srv_10.42.42.10(pid=24291): Terminating (SIGTERM) 01:31:53.671034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24292): Terminating (SIGTERM) 01:31:53.709619 run iperf3-srv_10.42.42.10(pid=24293): Terminating (SIGTERM) 01:31:53.748164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24296): Terminating (SIGTERM) 01:31:53.786896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24299): Terminating (SIGTERM) 01:31:53.825498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24302): Terminating (SIGTERM) 01:31:53.865115 --- ParallelTerminationStrategy: PID 24290 died... 01:31:53.883870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24290): Terminated: ok {rc=0} 01:31:53.926941 --- ParallelTerminationStrategy: PID 24291 died... 01:31:53.945272 run iperf3-srv_10.42.42.10(pid=24291): Terminated {rc=256} 01:31:53.988403 --- ParallelTerminationStrategy: PID 24292 died... 01:31:54.006806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24292): Terminated: ok {rc=0} 01:31:54.049870 --- ParallelTerminationStrategy: PID 24293 died... 01:31:54.068209 run iperf3-srv_10.42.42.10(pid=24293): Terminated {rc=256} 01:31:54.111379 --- ParallelTerminationStrategy: PID 24296 died... 01:31:54.129792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24296): Terminated: ok {rc=0} 01:31:54.172739 --- ParallelTerminationStrategy: PID 24299 died... 01:31:54.191203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24299): Terminated: ok {rc=0} 01:31:54.234100 --- ParallelTerminationStrategy: PID 24302 died... 01:31:54.252298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24302): Terminated: ok {rc=0} 01:31:54.338056 bus /gobi_0: Setting Powered False 01:31:55.436371 bus /gobi_0: Setting Powered False 01:31:56.549007 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 01:31:57.689649 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:57.701396 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:31:57.773461 tst iperf3.py: using LAC 37614 01:31:57.894035 tst iperf3.py: using RAC 129 01:31:58.014533 tst iperf3.py: using CellId 37614 01:31:58.132718 tst iperf3.py: using BVCI 37615 01:31:58.242259 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:58.253375 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:58.264198 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:58.275168 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:58.286016 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:58.296789 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:58.307790 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:58.318635 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:31:58.329504 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:31:58.449566 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:31:58.670026 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:31:58.998229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24304): Launched 01:31:59.284418 run iperf3-srv_10.42.42.10(pid=24305): Launched 01:31:59.407977 tst iperf3.py:8: start network... 01:31:59.628439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:32:00.133122 run create_hlr_db(pid=24306): Launched 01:32:00.258949 bus /gobi_6: Setting Powered False 01:32:01.319053 run create_hlr_db(pid=24306): Terminated: ok {rc=0} 01:32:01.799921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24308): Launched 01:32:02.161733 run osmo-hlr_10.42.42.2(pid=24309): Launched 01:32:02.351668 run osmo-stp_10.42.42.5: Starting osmo-stp 01:32:02.915209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24311): Launched 01:32:03.241703 run osmo-stp_10.42.42.5(pid=24312): Launched 01:32:03.369203 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:32:03.934701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24314): Launched 01:32:04.059712 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:32:04.335717 run patchelf(pid=24315): Launched 01:32:04.519492 run osmo-stp_10.42.42.5(pid=24312): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24312)] 01:32:04.657750 run osmo-stp_10.42.42.5(pid=24312): stdout: | (launched: 2022-12-14_01:32:03.180861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:04.797995 run osmo-stp_10.42.42.5(pid=24312): stderr: | [0;m[38;5;43m20221214013203374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013203374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013203375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013203375 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013203376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013203376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013203376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:04.938019 run osmo-stp_10.42.42.5(pid=24312): stdout: | (launched: 2022-12-14_01:32:03.180861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:05.071149 run osmo-stp_10.42.42.5(pid=24312): stderr: | [0;m[38;5;43m20221214013203374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013203374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013203375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013203375 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013203376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013203376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013203376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:05.228762 run patchelf(pid=24315): Terminating (SIGINT) 01:32:05.410842 run patchelf(pid=24315): Terminated: ok {rc=0} 01:32:05.543423 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24312): Process ended prematurely: osmo-stp_10.42.42.5(pid=24312) [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24312)] [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 01:32:05.553730 tst iperf3.py:8: Test FAILED (7.9 sec) 01:32:05.582649 run osmo-hlr_10.42.42.2(pid=24309): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24309)] 01:32:05.633667 run osmo-hlr_10.42.42.2(pid=24309): stdout: | (launched: 2022-12-14_01:32:02.094008) 01:32:05.686351 run osmo-hlr_10.42.42.2(pid=24309): stderr: | [0;m[1;31m20221214013202320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013202320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013202320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013202320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013202320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013202320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013202334 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013202342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013202343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013202343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:32:05.738826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24304): Terminating (SIGTERM) 01:32:05.780641 run iperf3-srv_10.42.42.10(pid=24305): Terminating (SIGTERM) 01:32:05.822820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24308): Terminating (SIGTERM) 01:32:05.865105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24311): Terminating (SIGTERM) 01:32:05.907259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24314): Terminating (SIGTERM) 01:32:05.949885 --- ParallelTerminationStrategy: PID 24304 died... 01:32:05.970366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24304): Terminated: ok {rc=0} 01:32:06.017118 --- ParallelTerminationStrategy: PID 24305 died... 01:32:06.036910 run iperf3-srv_10.42.42.10(pid=24305): Terminated {rc=256} 01:32:06.083141 --- ParallelTerminationStrategy: PID 24308 died... 01:32:06.103144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24308): Terminated: ok {rc=0} 01:32:06.149415 --- ParallelTerminationStrategy: PID 24311 died... 01:32:06.169335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24311): Terminated: ok {rc=0} 01:32:06.215507 --- ParallelTerminationStrategy: PID 24314 died... 01:32:06.235518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24314): Terminated: ok {rc=0} 01:32:06.323751 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 01:32:07.474526 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:07.486785 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:32:07.559616 tst iperf3m4.py: using LAC 37615 01:32:07.686307 tst iperf3m4.py: using RAC 130 01:32:07.813369 tst iperf3m4.py: using CellId 37615 01:32:07.940509 tst iperf3m4.py: using BVCI 37616 01:32:08.060896 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:08.072416 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:08.083654 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:08.094896 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:08.106819 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:08.118747 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:08.131012 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:08.142924 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:08.155033 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:32:08.275174 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:32:08.399079 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:32:08.518366 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:32:08.640112 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:32:08.860440 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:32:09.189077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24316): Launched 01:32:09.476387 run iperf3-srv_10.42.42.10(pid=24317): Launched 01:32:09.600735 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:32:09.820621 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:32:10.149018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24318): Launched 01:32:10.435674 run iperf3-srv_10.42.42.10(pid=24319): Launched 01:32:10.559214 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:32:10.778257 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:32:11.106507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24320): Launched 01:32:11.392853 run iperf3-srv_10.42.42.10(pid=24321): Launched 01:32:11.516692 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:32:11.735754 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:32:12.063549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24322): Launched 01:32:12.349797 run iperf3-srv_10.42.42.10(pid=24323): Launched 01:32:12.472236 tst iperf3m4.py:8: start network... 01:32:12.692415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:32:13.198022 run create_hlr_db(pid=24324): Launched 01:32:13.323742 bus /gobi_6: Setting Powered False 01:32:14.387233 run create_hlr_db(pid=24324): Terminated: ok {rc=0} 01:32:14.823927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24326): Launched 01:32:15.131577 run osmo-hlr_10.42.42.2(pid=24327): Launched 01:32:15.249724 run osmo-stp_10.42.42.5: Starting osmo-stp 01:32:15.780240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24329): Launched 01:32:16.125716 run osmo-stp_10.42.42.5(pid=24330): Launched 01:32:16.328929 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:32:17.006531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24332): Launched 01:32:17.156640 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:32:17.442442 run patchelf(pid=24333): Launched 01:32:17.626674 run osmo-stp_10.42.42.5(pid=24330): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24330)] 01:32:17.764568 run osmo-stp_10.42.42.5(pid=24330): stdout: | (launched: 2022-12-14_01:32:16.052376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:17.904568 run osmo-stp_10.42.42.5(pid=24330): stderr: | [0;m[38;5;43m20221214013216414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013216414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013216415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013216415 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013216416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013216416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013216416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:18.044296 run osmo-stp_10.42.42.5(pid=24330): stdout: | (launched: 2022-12-14_01:32:16.052376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:18.177860 run osmo-stp_10.42.42.5(pid=24330): stderr: | [0;m[38;5;43m20221214013216414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013216414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013216415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013216415 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013216416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013216416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013216416 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:18.335712 run patchelf(pid=24333): Terminating (SIGINT) 01:32:18.518346 run patchelf(pid=24333): Terminated: ok {rc=0} 01:32:18.649952 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24330): Process ended prematurely: osmo-stp_10.42.42.5(pid=24330) [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24330)] [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 01:32:18.660266 tst iperf3m4.py:8: Test FAILED (11.2 sec) 01:32:18.689284 run osmo-hlr_10.42.42.2(pid=24327): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24327)] 01:32:18.739929 run osmo-hlr_10.42.42.2(pid=24327): stdout: | (launched: 2022-12-14_01:32:15.074254) 01:32:18.792032 run osmo-hlr_10.42.42.2(pid=24327): stderr: | [0;m[1;31m20221214013215251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013215251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013215251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013215251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013215251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013215251 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013215263 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013215271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013215271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013215271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:32:18.844591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24316): Terminating (SIGTERM) 01:32:18.886390 run iperf3-srv_10.42.42.10(pid=24317): Terminating (SIGTERM) 01:32:18.928497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24318): Terminating (SIGTERM) 01:32:18.970967 run iperf3-srv_10.42.42.10(pid=24319): Terminating (SIGTERM) 01:32:19.013137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24320): Terminating (SIGTERM) 01:32:19.055429 run iperf3-srv_10.42.42.10(pid=24321): Terminating (SIGTERM) 01:32:19.097878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24322): Terminating (SIGTERM) 01:32:19.139999 run iperf3-srv_10.42.42.10(pid=24323): Terminating (SIGTERM) 01:32:19.181936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24326): Terminating (SIGTERM) 01:32:19.224072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24329): Terminating (SIGTERM) 01:32:19.266168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24332): Terminating (SIGTERM) 01:32:19.308526 --- ParallelTerminationStrategy: PID 24316 died... 01:32:19.329447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24316): Terminated: ok {rc=0} 01:32:19.376081 --- ParallelTerminationStrategy: PID 24317 died... 01:32:19.396086 run iperf3-srv_10.42.42.10(pid=24317): Terminated {rc=256} 01:32:19.442667 --- ParallelTerminationStrategy: PID 24318 died... 01:32:19.462745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24318): Terminated: ok {rc=0} 01:32:19.509300 --- ParallelTerminationStrategy: PID 24319 died... 01:32:19.528920 run iperf3-srv_10.42.42.10(pid=24319): Terminated {rc=256} 01:32:19.575854 --- ParallelTerminationStrategy: PID 24320 died... 01:32:19.595892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24320): Terminated: ok {rc=0} 01:32:19.642619 --- ParallelTerminationStrategy: PID 24321 died... 01:32:19.663150 run iperf3-srv_10.42.42.10(pid=24321): Terminated {rc=256} 01:32:19.709583 --- ParallelTerminationStrategy: PID 24322 died... 01:32:19.729513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24322): Terminated: ok {rc=0} 01:32:19.775615 --- ParallelTerminationStrategy: PID 24323 died... 01:32:19.795593 run iperf3-srv_10.42.42.10(pid=24323): Terminated {rc=256} 01:32:19.841511 --- ParallelTerminationStrategy: PID 24326 died... 01:32:19.861453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24326): Terminated: ok {rc=0} 01:32:19.907635 --- ParallelTerminationStrategy: PID 24329 died... 01:32:19.927692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24329): Terminated: ok {rc=0} 01:32:19.973907 --- ParallelTerminationStrategy: PID 24332 died... 01:32:19.993926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24332): Terminated: ok {rc=0} 01:32:20.084143 bus /gobi_4: Setting Powered False 01:32:21.182202 bus /gobi_4: Setting Powered False 01:32:22.300885 bus /gobi_1: Setting Powered False 01:32:23.402915 bus /gobi_1: Setting Powered False 01:32:24.520698 bus /gobi_0: Setting Powered False 01:32:25.622108 bus /gobi_0: Setting Powered False 01:32:26.739275 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 01:32:27.841630 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:27.853876 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:32:27.926736 tst ping.py: using LAC 37616 01:32:28.053930 tst ping.py: using RAC 131 01:32:28.179103 tst ping.py: using CellId 37616 01:32:28.303762 tst ping.py: using BVCI 37617 01:32:28.419582 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:28.431202 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:28.443043 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:28.454365 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:28.466120 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:28.477914 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:28.489772 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:28.501654 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:32:28.620799 tst ping.py:19: start network... 01:32:28.835550 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:32:29.330424 run create_hlr_db(pid=24334): Launched 01:32:29.453491 bus /gobi_6: Setting Powered False 01:32:30.513333 run create_hlr_db(pid=24334): Terminated: ok {rc=0} 01:32:30.983453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24336): Launched 01:32:31.300488 run osmo-hlr_10.42.42.2(pid=24337): Launched 01:32:31.527246 run osmo-stp_10.42.42.5: Starting osmo-stp 01:32:32.249956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24339): Launched 01:32:32.549022 run osmo-stp_10.42.42.5(pid=24340): Launched 01:32:32.662246 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:32:33.177865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24342): Launched 01:32:33.291937 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:32:33.545159 run patchelf(pid=24343): Launched 01:32:33.710979 run osmo-stp_10.42.42.5(pid=24340): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24340)] 01:32:33.837617 run osmo-stp_10.42.42.5(pid=24340): stdout: | (launched: 2022-12-14_01:32:32.492893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:33.965275 run osmo-stp_10.42.42.5(pid=24340): stderr: | [0;m[38;5;43m20221214013232663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013232663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013232664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013232664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013232665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013232665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013232665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:34.093103 run osmo-stp_10.42.42.5(pid=24340): stdout: | (launched: 2022-12-14_01:32:32.492893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:34.214371 run osmo-stp_10.42.42.5(pid=24340): stderr: | [0;m[38;5;43m20221214013232663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013232663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013232664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013232664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013232665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013232665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013232665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:34.358423 run patchelf(pid=24343): Terminating (SIGINT) 01:32:34.525236 run patchelf(pid=24343): Terminated: ok {rc=0} 01:32:34.645256 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24340): Process ended prematurely: osmo-stp_10.42.42.5(pid=24340) [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24340)] [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 01:32:34.654129 tst ping.py:22: Test FAILED (6.8 sec) 01:32:34.680758 run osmo-hlr_10.42.42.2(pid=24337): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24337)] 01:32:34.728383 run osmo-hlr_10.42.42.2(pid=24337): stdout: | (launched: 2022-12-14_01:32:31.242103) 01:32:34.777449 run osmo-hlr_10.42.42.2(pid=24337): stderr: | [0;m[1;31m20221214013231581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013231582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013231582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013231582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013231582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013231582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013231605 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013231615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013231616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013231616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:32:34.827029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24336): Terminating (SIGTERM) 01:32:34.866370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24339): Terminating (SIGTERM) 01:32:34.905793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24342): Terminating (SIGTERM) 01:32:34.945681 --- ParallelTerminationStrategy: PID 24336 died... 01:32:34.964241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24336): Terminated: ok {rc=0} 01:32:35.008284 --- ParallelTerminationStrategy: PID 24339 died... 01:32:35.027067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24339): Terminated: ok {rc=0} 01:32:35.070682 --- ParallelTerminationStrategy: PID 24342 died... 01:32:35.089341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24342): Terminated: ok {rc=0} 01:32:35.175167 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 01:32:36.264810 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:36.277146 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:32:36.346623 tst ping_idle_ping.py: using LAC 37617 01:32:36.462264 tst ping_idle_ping.py: using RAC 132 01:32:36.577878 tst ping_idle_ping.py: using CellId 37617 01:32:36.703172 tst ping_idle_ping.py: using BVCI 37618 01:32:36.819770 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:36.831390 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:36.842912 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:36.854444 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:36.866173 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:36.877724 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:36.889410 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:32:36.900783 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:32:37.016003 tst ping_idle_ping.py:24: start network... 01:32:37.215427 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:32:37.683169 run create_hlr_db(pid=24344): Launched 01:32:37.808740 bus /gobi_6: Setting Powered False 01:32:38.869692 run create_hlr_db(pid=24344): Terminated: ok {rc=0} 01:32:39.311240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24346): Launched 01:32:39.634921 run osmo-hlr_10.42.42.2(pid=24347): Launched 01:32:39.758510 run osmo-stp_10.42.42.5: Starting osmo-stp 01:32:40.313063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24349): Launched 01:32:40.636709 run osmo-stp_10.42.42.5(pid=24350): Launched 01:32:40.759487 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:32:41.312477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24352): Launched 01:32:41.436239 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:32:41.707604 run patchelf(pid=24353): Launched 01:32:41.886703 run osmo-stp_10.42.42.5(pid=24350): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24350)] 01:32:42.021940 run osmo-stp_10.42.42.5(pid=24350): stdout: | (launched: 2022-12-14_01:32:40.576628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:42.159012 run osmo-stp_10.42.42.5(pid=24350): stderr: | [0;m[38;5;43m20221214013240771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013240771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013240772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013240772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013240772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013240773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013240773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:42.295861 run osmo-stp_10.42.42.5(pid=24350): stdout: | (launched: 2022-12-14_01:32:40.576628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:42.426460 run osmo-stp_10.42.42.5(pid=24350): stderr: | [0;m[38;5;43m20221214013240771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013240771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013240772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013240772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013240772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013240773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013240773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:42.581732 run patchelf(pid=24353): Terminating (SIGINT) 01:32:42.760018 run patchelf(pid=24353): Terminated: ok {rc=0} 01:32:42.888613 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24350): Process ended prematurely: osmo-stp_10.42.42.5(pid=24350) [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24350)] [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 01:32:42.898332 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 01:32:42.926596 run osmo-hlr_10.42.42.2(pid=24347): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24347)] 01:32:42.977254 run osmo-hlr_10.42.42.2(pid=24347): stdout: | (launched: 2022-12-14_01:32:39.575212) 01:32:43.029111 run osmo-hlr_10.42.42.2(pid=24347): stderr: | [0;m[1;31m20221214013239774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013239774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013239774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013239774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013239774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013239774 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013239786 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013239794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013239794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013239794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:32:43.081379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24346): Terminating (SIGTERM) 01:32:43.123528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24349): Terminating (SIGTERM) 01:32:43.165876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24352): Terminating (SIGTERM) 01:32:43.208433 --- ParallelTerminationStrategy: PID 24346 died... 01:32:43.228915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24346): Terminated: ok {rc=0} 01:32:43.275395 --- ParallelTerminationStrategy: PID 24349 died... 01:32:43.295133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24349): Terminated: ok {rc=0} 01:32:43.341652 --- ParallelTerminationStrategy: PID 24352 died... 01:32:43.361708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24352): Terminated: ok {rc=0} 01:32:43.450484 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:32:44.755309 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:32:44.762253 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:32:44.795115 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:32:44.829880 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:32:44.886601 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:32:44.919707 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:32:44.953853 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:32:45.510775 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2397 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:32:45.516315 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:32:45.528204 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:32:45.598986 tst switch_tch_pdch.py: using LAC 37618 01:32:45.723769 tst switch_tch_pdch.py: using RAC 133 01:32:45.857938 tst switch_tch_pdch.py: using CellId 37618 01:32:45.984842 tst switch_tch_pdch.py: using BVCI 37619 01:32:46.106765 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:32:46.119761 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:32:46.132486 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:32:46.145275 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:32:46.158627 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:32:46.171887 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:32:46.185596 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:32:46.198806 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:32:46.324437 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:32:46.451104 tst switch_tch_pdch.py:51: start network... 01:32:46.678074 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:32:47.180626 run create_hlr_db(pid=24359): Launched 01:32:47.321428 bus /gobi_6: Setting Powered False 01:32:48.384824 run create_hlr_db(pid=24359): Terminated: ok {rc=0} 01:32:48.816145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24361): Launched 01:32:49.117526 run osmo-hlr_10.42.42.2(pid=24362): Launched 01:32:49.231720 run osmo-stp_10.42.42.5: Starting osmo-stp 01:32:49.750550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24364): Launched 01:32:50.052119 run osmo-stp_10.42.42.5(pid=24365): Launched 01:32:50.166949 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:32:50.681150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24367): Launched 01:32:50.794992 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:32:51.046925 run patchelf(pid=24368): Launched 01:32:51.223267 run osmo-stp_10.42.42.5(pid=24365): ERR: Terminated: ERROR {rc=1} [trial-2397↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24365)] 01:32:51.358304 run osmo-stp_10.42.42.5(pid=24365): stdout: | (launched: 2022-12-14_01:32:49.995954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:51.495215 run osmo-stp_10.42.42.5(pid=24365): stderr: | [0;m[38;5;43m20221214013250168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013250168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013250169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013250169 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013250169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013250169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013250170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:51.631967 run osmo-stp_10.42.42.5(pid=24365): stdout: | (launched: 2022-12-14_01:32:49.995954) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:32:51.762509 run osmo-stp_10.42.42.5(pid=24365): stderr: | [0;m[38;5;43m20221214013250168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013250168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013250169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013250169 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013250169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013250169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013250170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:32:51.917393 run patchelf(pid=24368): Terminating (SIGINT) 01:32:52.095570 run patchelf(pid=24368): Terminated: ok {rc=0} 01:32:52.223959 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24365): Process ended prematurely: osmo-stp_10.42.42.5(pid=24365) [trial-2397↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24365)] [trial-2397↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:32:52.233547 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 01:32:52.261612 run osmo-hlr_10.42.42.2(pid=24362): ERR: Terminated: ERROR {rc=237} [trial-2397↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24362)] 01:32:52.311762 run osmo-hlr_10.42.42.2(pid=24362): stdout: | (launched: 2022-12-14_01:32:49.061090) 01:32:52.363771 run osmo-hlr_10.42.42.2(pid=24362): stderr: | [0;m[1;31m20221214013249235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013249235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013249235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013249235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013249235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013249236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013249261 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013249269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013249270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013249270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:32:52.416116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24361): Terminating (SIGTERM) 01:32:52.458572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24364): Terminating (SIGTERM) 01:32:52.500872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24367): Terminating (SIGTERM) 01:32:52.543209 --- ParallelTerminationStrategy: PID 24361 died... 01:32:52.563764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24361): Terminated: ok {rc=0} 01:32:52.610166 --- ParallelTerminationStrategy: PID 24364 died... 01:32:52.630374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24364): Terminated: ok {rc=0} 01:32:52.676475 --- ParallelTerminationStrategy: PID 24367 died... 01:32:52.696575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24367): Terminated: ok {rc=0} 01:32:52.785183 bus /gobi_0: Setting Powered False 01:32:53.882439 bus /gobi_0: Setting Powered False 01:32:54.998659 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 01:32:56.253639 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:32:56.259784 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 01:32:56.293607 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 01:32:56.329514 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 01:32:56.385300 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 01:32:56.418258 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 01:32:56.452507 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 01:32:57.009719 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2397 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 01:32:57.014897 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:32:57.026055 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 01:32:57.095796 tst switch_tch_pdch.py: using LAC 37619 01:32:57.213875 tst switch_tch_pdch.py: using RAC 134 01:32:57.329476 tst switch_tch_pdch.py: using CellId 37619 01:32:57.443805 tst switch_tch_pdch.py: using BVCI 37620 01:32:57.551823 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:32:57.562875 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:32:57.573608 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:32:57.584320 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:32:57.594983 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:32:57.605823 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:32:57.616615 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:32:57.627307 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:32:57.746954 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:32:57.863560 tst switch_tch_pdch.py:51: start network... 01:32:58.064495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:32:58.501748 run create_hlr_db(pid=24374): Launched 01:32:58.626178 bus /gobi_6: Setting Powered False 01:32:59.685891 run create_hlr_db(pid=24374): Terminated: ok {rc=0} 01:33:00.097710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24376): Launched 01:33:00.420675 run osmo-hlr_10.42.42.2(pid=24377): Launched 01:33:00.544562 run osmo-stp_10.42.42.5: Starting osmo-stp 01:33:01.084656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24379): Launched 01:33:01.458841 run osmo-stp_10.42.42.5(pid=24381): Launched 01:33:01.590135 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:33:02.217020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24383): Launched 01:33:02.353734 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:33:02.627528 run patchelf(pid=24384): Launched 01:33:02.806784 run osmo-stp_10.42.42.5(pid=24381): ERR: Terminated: ERROR {rc=1} [trial-2397↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24381)] 01:33:02.942205 run osmo-stp_10.42.42.5(pid=24381): stdout: | (launched: 2022-12-14_01:33:01.398092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:03.079634 run osmo-stp_10.42.42.5(pid=24381): stderr: | [0;m[38;5;43m20221214013301794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013301794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013301798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013301798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013301799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013301799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013301799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:03.217320 run osmo-stp_10.42.42.5(pid=24381): stdout: | (launched: 2022-12-14_01:33:01.398092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:03.348296 run osmo-stp_10.42.42.5(pid=24381): stderr: | [0;m[38;5;43m20221214013301794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013301794 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013301798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013301798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013301799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013301799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013301799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:03.503787 run patchelf(pid=24384): Terminating (SIGINT) 01:33:03.683441 run patchelf(pid=24384): Terminated: ok {rc=0} 01:33:03.812787 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24381): Process ended prematurely: osmo-stp_10.42.42.5(pid=24381) [trial-2397↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24381)] [trial-2397↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 01:33:03.822507 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 01:33:03.850196 run osmo-hlr_10.42.42.2(pid=24377): ERR: Terminated: ERROR {rc=237} [trial-2397↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24377)] 01:33:03.901496 run osmo-hlr_10.42.42.2(pid=24377): stdout: | (launched: 2022-12-14_01:33:00.361222) 01:33:03.953559 run osmo-hlr_10.42.42.2(pid=24377): stderr: | [0;m[1;31m20221214013300561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013300561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013300561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013300561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013300561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013300561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013300572 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013300582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013300582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013300582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:33:04.006811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24376): Terminating (SIGTERM) 01:33:04.048827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24379): Terminating (SIGTERM) 01:33:04.091055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24383): Terminating (SIGTERM) 01:33:04.133254 --- ParallelTerminationStrategy: PID 24376 died... 01:33:04.153606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24376): Terminated: ok {rc=0} 01:33:04.199616 --- ParallelTerminationStrategy: PID 24379 died... 01:33:04.219347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24379): Terminated: ok {rc=0} 01:33:04.264870 --- ParallelTerminationStrategy: PID 24383 died... 01:33:04.285082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24383): Terminated: ok {rc=0} 01:33:04.372902 bus /gobi_0: Setting Powered False 01:33:05.470990 bus /gobi_0: Setting Powered False 01:33:06.585945 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 01:33:07.842781 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:33:07.847697 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 01:33:07.879339 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 01:33:07.886767 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 01:33:07.938049 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 01:33:07.968577 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 01:33:07.975648 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 01:33:08.517228 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 01:33:08.523337 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 01:33:08.535334 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:33:08.581214 tst mo_mt_sms.py: using LAC 37620 01:33:08.700798 tst mo_mt_sms.py: using RAC 135 01:33:08.821514 tst mo_mt_sms.py: using CellId 37620 01:33:08.938012 tst mo_mt_sms.py: using BVCI 37621 01:33:09.044857 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:33:09.164615 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:33:09.278854 tst mo_mt_sms.py:9: start nitb and bts... 01:33:09.480309 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:33:10.090938 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24388): Launched 01:33:10.390490 run osmo-nitb_10.42.42.2(pid=24389): Launched 01:33:10.556578 run osmo-nitb_10.42.42.2(pid=24389): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24389)] 01:33:10.689849 run osmo-nitb_10.42.42.2(pid=24389): stdout: | (launched: 2022-12-14_01:33:10.334570) 01:33:10.824751 run osmo-nitb_10.42.42.2(pid=24389): stderr: | (launched: 2022-12-14_01:33:10.378613) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:33:10.959572 run osmo-nitb_10.42.42.2(pid=24389): stdout: | (launched: 2022-12-14_01:33:10.334570) 01:33:11.087892 run osmo-nitb_10.42.42.2(pid=24389): stderr: | (launched: 2022-12-14_01:33:10.378613) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8b7301f268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24389): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24389) [trial-2397↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24389)] 01:33:11.504034 tst osmo-nitb_10.42.42.2(pid=24389): stdout: | (launched: 2022-12-14_01:33:10.334570) 01:33:11.624370 tst osmo-nitb_10.42.42.2(pid=24389): stderr: | (launched: 2022-12-14_01:33:10.378613) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:33:11.765254 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=24389): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24389) [trial-2397↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24389)] [trial-2397↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 01:33:11.773622 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 01:33:11.780120 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24388): Terminating (SIGTERM) 01:33:11.987845 --- ParallelTerminationStrategy: PID 24388 died... 01:33:12.008305 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24388): Terminated: ok {rc=0} 01:33:12.091107 bus /sierra_3: Setting Powered False 01:33:13.189637 bus /sierra_3: Setting Powered False 01:33:14.306624 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 01:33:15.501541 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:33:15.506143 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 01:33:15.536195 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 01:33:15.564713 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 01:33:15.618973 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 01:33:15.649273 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 01:33:15.677468 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 01:33:16.220858 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 01:33:16.230265 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:16.242541 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:33:16.286596 tst mo_mt_sms.py: using LAC 37621 01:33:16.434454 tst mo_mt_sms.py: using RAC 136 01:33:16.565248 tst mo_mt_sms.py: using CellId 37621 01:33:16.693658 tst mo_mt_sms.py: using BVCI 37622 01:33:16.813682 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:16.826087 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:16.838376 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:16.850581 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:16.864848 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:16.877986 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:33:17.004111 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:33:17.123260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:33:17.590320 run create_hlr_db(pid=24393): Launched 01:33:17.713734 bus /sierra_2: Setting Powered False 01:33:18.774471 run create_hlr_db(pid=24393): Terminated: ok {rc=0} 01:33:19.212498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24395): Launched 01:33:19.534838 run osmo-hlr_10.42.42.2(pid=24396): Launched 01:33:19.656327 run osmo-stp_10.42.42.5: Starting osmo-stp 01:33:20.209204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24398): Launched 01:33:20.531644 run osmo-stp_10.42.42.5(pid=24399): Launched 01:33:20.655114 run osmo-msc_10.42.42.6: Starting osmo-msc 01:33:21.237120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24401): Launched 01:33:21.560901 run osmo-msc_10.42.42.6(pid=24402): Launched 01:33:21.741868 run osmo-stp_10.42.42.5(pid=24399): ERR: Terminated: ERROR {rc=1} [trial-2397↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24399)] 01:33:21.878480 run osmo-stp_10.42.42.5(pid=24399): stdout: | (launched: 2022-12-14_01:33:20.471918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:22.014373 run osmo-stp_10.42.42.5(pid=24399): stderr: | [0;m[38;5;43m20221214013320666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013320666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013320666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013320666 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013320667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013320667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013320667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:22.149611 run osmo-stp_10.42.42.5(pid=24399): stdout: | (launched: 2022-12-14_01:33:20.471918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:22.277434 run osmo-stp_10.42.42.5(pid=24399): stderr: | [0;m[38;5;43m20221214013320666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013320666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013320666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013320666 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013320667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013320667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013320667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:22.430260 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=24399): Process ended prematurely: osmo-stp_10.42.42.5(pid=24399) [trial-2397↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24399)] [trial-2397↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 01:33:22.439301 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 01:33:22.467566 run osmo-hlr_10.42.42.2(pid=24396): ERR: Terminated: ERROR {rc=237} [trial-2397↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24396)] 01:33:22.518728 run osmo-hlr_10.42.42.2(pid=24396): stdout: | (launched: 2022-12-14_01:33:19.474658) 01:33:22.571017 run osmo-hlr_10.42.42.2(pid=24396): stderr: | [0;m[1;31m20221214013319674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013319674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013319674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013319674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013319674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013319674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013319686 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013319696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013319696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013319696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:33:22.643941 run osmo-msc_10.42.42.6(pid=24402): ERR: Terminated: ERROR {rc=2} [trial-2397↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24402)] 01:33:22.694316 run osmo-msc_10.42.42.6(pid=24402): stdout: | (launched: 2022-12-14_01:33:21.500853) 01:33:22.746529 run osmo-msc_10.42.42.6(pid=24402): stderr: | [0;m[38;5;43m20221214013321823 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214013321823 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f857e362c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214013321824 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214013321824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214013321824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214013321824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214013321826 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214013321826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214013321827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214013321827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:33:22.799378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24395): Terminating (SIGTERM) 01:33:22.841826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24398): Terminating (SIGTERM) 01:33:22.884942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24401): Terminating (SIGTERM) 01:33:22.927943 --- ParallelTerminationStrategy: PID 24395 died... 01:33:22.948789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24395): Terminated: ok {rc=0} 01:33:22.995910 --- ParallelTerminationStrategy: PID 24398 died... 01:33:23.016322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24398): Terminated: ok {rc=0} 01:33:23.063306 --- ParallelTerminationStrategy: PID 24401 died... 01:33:23.083822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24401): Terminated: ok {rc=0} 01:33:23.173942 bus /sierra_3: Setting Powered False 01:33:24.273744 bus /sierra_3: Setting Powered False 01:33:25.390479 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 01:33:26.620042 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:33:26.624072 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 01:33:26.653967 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 01:33:26.661359 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 01:33:26.700486 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 01:33:26.731440 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 01:33:26.738505 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 01:33:27.257186 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2397 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 01:33:27.262661 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 01:33:27.274408 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:33:27.321279 tst assert_extension.py: using LAC 37622 01:33:27.447207 tst assert_extension.py: using RAC 137 01:33:27.573375 tst assert_extension.py: using CellId 37622 01:33:27.701979 tst assert_extension.py: using BVCI 37623 01:33:27.818939 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 01:33:27.934154 tst assert_extension.py:10: start nitb and bts... 01:33:28.133884 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:33:28.745499 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24407): Launched 01:33:29.046027 run osmo-nitb_10.42.42.2(pid=24408): Launched 01:33:29.213659 run osmo-nitb_10.42.42.2(pid=24408): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24408)] 01:33:29.347574 run osmo-nitb_10.42.42.2(pid=24408): stdout: | (launched: 2022-12-14_01:33:28.989741) 01:33:29.483274 run osmo-nitb_10.42.42.2(pid=24408): stderr: | (launched: 2022-12-14_01:33:29.034061) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:33:29.618891 run osmo-nitb_10.42.42.2(pid=24408): stdout: | (launched: 2022-12-14_01:33:28.989741) 01:33:29.748442 run osmo-nitb_10.42.42.2(pid=24408): stderr: | (launched: 2022-12-14_01:33:29.034061) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8b7301f268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24408): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24408) [trial-2397↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24408)] 01:33:30.160544 tst osmo-nitb_10.42.42.2(pid=24408): stdout: | (launched: 2022-12-14_01:33:28.989741) 01:33:30.281923 tst osmo-nitb_10.42.42.2(pid=24408): stderr: | (launched: 2022-12-14_01:33:29.034061) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:33:30.422820 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=24408): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24408) [trial-2397↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24408)] [trial-2397↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 01:33:30.431250 tst assert_extension.py:12: Test FAILED (3.2 sec) 01:33:30.438061 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24407): Terminating (SIGTERM) 01:33:30.646565 --- ParallelTerminationStrategy: PID 24407 died... 01:33:30.667679 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24407): Terminated: ok {rc=0} 01:33:30.754255 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 01:33:31.950958 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:33:31.955887 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 01:33:31.997678 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 01:33:32.025975 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 01:33:32.062750 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 01:33:32.094821 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 01:33:32.123573 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 01:33:32.648262 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2397 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 01:33:32.654331 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:32.665841 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:33:32.709770 tst assert_extension.py: using LAC 37623 01:33:32.837199 tst assert_extension.py: using RAC 138 01:33:32.962801 tst assert_extension.py: using CellId 37623 01:33:33.089207 tst assert_extension.py: using BVCI 37624 01:33:33.205897 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:33.217429 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:33.228704 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:33.239753 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:33.251135 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:33:33.262523 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 01:33:33.381346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:33:33.875748 run create_hlr_db(pid=24412): Launched 01:33:33.998373 bus /sierra_2: Setting Powered False 01:33:35.061416 run create_hlr_db(pid=24412): Terminated: ok {rc=0} 01:33:35.489248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24414): Launched 01:33:35.788068 run osmo-hlr_10.42.42.2(pid=24415): Launched 01:33:35.903401 run osmo-stp_10.42.42.5: Starting osmo-stp 01:33:36.437131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24417): Launched 01:33:36.735186 run osmo-stp_10.42.42.5(pid=24418): Launched 01:33:36.849957 run osmo-msc_10.42.42.6: Starting osmo-msc 01:33:37.389769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24420): Launched 01:33:37.689076 run osmo-msc_10.42.42.6(pid=24421): Launched 01:33:37.854609 run osmo-stp_10.42.42.5(pid=24418): ERR: Terminated: ERROR {rc=1} [trial-2397↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24418)] 01:33:37.980106 run osmo-stp_10.42.42.5(pid=24418): stdout: | (launched: 2022-12-14_01:33:36.678995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:38.105747 run osmo-stp_10.42.42.5(pid=24418): stderr: | [0;m[38;5;43m20221214013336848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013336848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013336848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013336849 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013336849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013336849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013336849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:38.228941 run osmo-stp_10.42.42.5(pid=24418): stdout: | (launched: 2022-12-14_01:33:36.678995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:38.347636 run osmo-stp_10.42.42.5(pid=24418): stderr: | [0;m[38;5;43m20221214013336848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013336848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013336848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013336849 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013336849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013336849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013336849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:38.489395 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=24418): Process ended prematurely: osmo-stp_10.42.42.5(pid=24418) [trial-2397↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24418)] [trial-2397↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 01:33:38.497513 tst assert_extension.py:17: Test FAILED (5.8 sec) 01:33:38.523470 run osmo-hlr_10.42.42.2(pid=24415): ERR: Terminated: ERROR {rc=237} [trial-2397↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24415)] 01:33:38.570852 run osmo-hlr_10.42.42.2(pid=24415): stdout: | (launched: 2022-12-14_01:33:35.731928) 01:33:38.619527 run osmo-hlr_10.42.42.2(pid=24415): stderr: | [0;m[1;31m20221214013335909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013335909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013335909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013335909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013335909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013335909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013335922 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013335930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013335931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013335931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:33:38.687568 run osmo-msc_10.42.42.6(pid=24421): ERR: Terminated: ERROR {rc=2} [trial-2397↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24421)] 01:33:38.734397 run osmo-msc_10.42.42.6(pid=24421): stdout: | (launched: 2022-12-14_01:33:37.633148) 01:33:38.782919 run osmo-msc_10.42.42.6(pid=24421): stderr: | [0;m[38;5;43m20221214013337905 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214013337905 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2252737c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214013337905 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214013337905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214013337905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214013337906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214013337907 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214013337908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214013337908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214013337908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:33:38.831926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24414): Terminating (SIGTERM) 01:33:38.871132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24417): Terminating (SIGTERM) 01:33:38.910386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24420): Terminating (SIGTERM) 01:33:38.949974 --- ParallelTerminationStrategy: PID 24414 died... 01:33:38.968913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24414): Terminated: ok {rc=0} 01:33:39.012368 --- ParallelTerminationStrategy: PID 24417 died... 01:33:39.030933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24417): Terminated: ok {rc=0} 01:33:39.074194 --- ParallelTerminationStrategy: PID 24420 died... 01:33:39.092661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24420): Terminated: ok {rc=0} 01:33:39.175993 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 01:33:40.381968 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:33:40.388468 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 01:33:40.417473 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 01:33:40.444176 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 01:33:40.496723 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 01:33:40.527359 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 01:33:40.555156 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 01:33:41.104028 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 01:33:41.153446 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:41.164732 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:33:41.229707 tst mo_mt_call.py: using LAC 37624 01:33:41.350529 tst mo_mt_call.py: using RAC 139 01:33:41.470880 tst mo_mt_call.py: using CellId 37624 01:33:41.604718 tst mo_mt_call.py: using BVCI 37625 01:33:41.724343 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:41.736365 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:41.748202 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:41.759987 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:41.771952 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:41.783780 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:33:41.901920 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:33:42.023219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:33:42.528305 run create_hlr_db(pid=24426): Launched 01:33:42.651918 bus /sierra_2: Setting Powered False 01:33:43.716849 run create_hlr_db(pid=24426): Terminated: ok {rc=0} 01:33:44.151491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24428): Launched 01:33:44.458497 run osmo-hlr_10.42.42.2(pid=24429): Launched 01:33:44.576120 run osmo-stp_10.42.42.5: Starting osmo-stp 01:33:45.099231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24431): Launched 01:33:45.405698 run osmo-stp_10.42.42.5(pid=24432): Launched 01:33:45.524079 run osmo-msc_10.42.42.6: Starting osmo-msc 01:33:46.106767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24434): Launched 01:33:46.437674 run osmo-msc_10.42.42.6(pid=24435): Launched 01:33:46.787064 run osmo-stp_10.42.42.5(pid=24432): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24432)] 01:33:47.050147 run osmo-stp_10.42.42.5(pid=24432): stdout: | (launched: 2022-12-14_01:33:45.348519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:47.219580 run osmo-stp_10.42.42.5(pid=24432): stderr: | [0;m[38;5;43m20221214013345520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013345520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013345520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013345521 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013345521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013345521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013345521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:47.359801 run osmo-stp_10.42.42.5(pid=24432): stdout: | (launched: 2022-12-14_01:33:45.348519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:47.480231 run osmo-stp_10.42.42.5(pid=24432): stderr: | [0;m[38;5;43m20221214013345520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013345520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013345520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013345521 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013345521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013345521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013345521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:47.624151 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24432): Process ended prematurely: osmo-stp_10.42.42.5(pid=24432) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24432)] [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 01:33:47.633226 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 01:33:47.659583 run osmo-hlr_10.42.42.2(pid=24429): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24429)] 01:33:47.706714 run osmo-hlr_10.42.42.2(pid=24429): stdout: | (launched: 2022-12-14_01:33:44.401450) 01:33:47.755516 run osmo-hlr_10.42.42.2(pid=24429): stderr: | [0;m[1;31m20221214013344578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013344578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013344578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013344578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013344578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013344578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013344590 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013344601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013344601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013344601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:33:47.823888 run osmo-msc_10.42.42.6(pid=24435): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24435)] 01:33:47.870777 run osmo-msc_10.42.42.6(pid=24435): stdout: | (launched: 2022-12-14_01:33:46.375676) 01:33:47.919403 run osmo-msc_10.42.42.6(pid=24435): stderr: | [0;m[38;5;43m20221214013346808 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214013346808 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fec25ac6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214013346808 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214013346808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214013346810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214013346814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214013346816 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214013346818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214013346821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214013346821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:33:47.968155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24428): Terminating (SIGTERM) 01:33:48.007098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24431): Terminating (SIGTERM) 01:33:48.046125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24434): Terminating (SIGTERM) 01:33:48.086075 --- ParallelTerminationStrategy: PID 24428 died... 01:33:48.104886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24428): Terminated: ok {rc=0} 01:33:48.148243 --- ParallelTerminationStrategy: PID 24431 died... 01:33:48.166749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24431): Terminated: ok {rc=0} 01:33:48.210092 --- ParallelTerminationStrategy: PID 24434 died... 01:33:48.228597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24434): Terminated: ok {rc=0} 01:33:48.311446 bus /sierra_3: Setting Powered False 01:33:49.409258 bus /sierra_3: Setting Powered False 01:33:50.527074 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 01:33:51.672064 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:51.684129 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:33:51.749832 tst mo_mt_call_osmux.py: using LAC 37625 01:33:51.871190 tst mo_mt_call_osmux.py: using RAC 140 01:33:51.990910 tst mo_mt_call_osmux.py: using CellId 37625 01:33:52.111615 tst mo_mt_call_osmux.py: using BVCI 37626 01:33:52.222657 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:52.234078 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:52.245188 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:52.256230 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:52.267401 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:33:52.278438 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:33:52.392745 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:33:52.514089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:33:53.021332 run create_hlr_db(pid=24437): Launched 01:33:53.146093 bus /sierra_2: Setting Powered False 01:33:54.210209 run create_hlr_db(pid=24437): Terminated: ok {rc=0} 01:33:54.646869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24439): Launched 01:33:54.953261 run osmo-hlr_10.42.42.2(pid=24440): Launched 01:33:55.069235 run osmo-stp_10.42.42.5: Starting osmo-stp 01:33:55.612339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24442): Launched 01:33:55.917330 run osmo-stp_10.42.42.5(pid=24443): Launched 01:33:56.033322 run osmo-msc_10.42.42.6: Starting osmo-msc 01:33:56.586856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24445): Launched 01:33:56.893250 run osmo-msc_10.42.42.6(pid=24446): Launched 01:33:57.063365 run osmo-stp_10.42.42.5(pid=24443): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24443)] 01:33:57.191269 run osmo-stp_10.42.42.5(pid=24443): stdout: | (launched: 2022-12-14_01:33:55.860312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:57.319246 run osmo-stp_10.42.42.5(pid=24443): stderr: | [0;m[38;5;43m20221214013356029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013356029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013356029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013356030 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013356030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013356030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013356030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:57.445327 run osmo-stp_10.42.42.5(pid=24443): stdout: | (launched: 2022-12-14_01:33:55.860312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:33:57.565563 run osmo-stp_10.42.42.5(pid=24443): stderr: | [0;m[38;5;43m20221214013356029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013356029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013356029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013356030 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013356030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013356030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013356030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:33:57.710821 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24443): Process ended prematurely: osmo-stp_10.42.42.5(pid=24443) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24443)] [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 01:33:57.719678 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:33:57.745891 run osmo-hlr_10.42.42.2(pid=24440): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24440)] 01:33:57.793294 run osmo-hlr_10.42.42.2(pid=24440): stdout: | (launched: 2022-12-14_01:33:54.896267) 01:33:57.841709 run osmo-hlr_10.42.42.2(pid=24440): stderr: | [0;m[1;31m20221214013355074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013355074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013355074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013355074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013355074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013355074 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013355087 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013355096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013355096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013355096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:33:57.909382 run osmo-msc_10.42.42.6(pid=24446): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24446)] 01:33:57.956059 run osmo-msc_10.42.42.6(pid=24446): stdout: | (launched: 2022-12-14_01:33:56.835104) 01:33:58.004165 run osmo-msc_10.42.42.6(pid=24446): stderr: | [0;m[38;5;43m20221214013357108 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214013357108 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f62b845ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214013357108 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214013357108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214013357108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214013357108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214013357110 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214013357110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214013357111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214013357111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:33:58.052882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24439): Terminating (SIGTERM) 01:33:58.091793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24442): Terminating (SIGTERM) 01:33:58.130804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24445): Terminating (SIGTERM) 01:33:58.170074 --- ParallelTerminationStrategy: PID 24439 died... 01:33:58.189083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24439): Terminated: ok {rc=0} 01:33:58.232438 --- ParallelTerminationStrategy: PID 24442 died... 01:33:58.250969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24442): Terminated: ok {rc=0} 01:33:58.294026 --- ParallelTerminationStrategy: PID 24445 died... 01:33:58.312526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24445): Terminated: ok {rc=0} 01:33:58.396783 bus /sierra_3: Setting Powered False 01:33:59.494495 bus /sierra_3: Setting Powered False 01:34:00.606164 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 01:34:01.880866 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:34:01.889306 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 01:34:01.920340 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 01:34:01.950496 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 01:34:02.006299 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 01:34:02.043448 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 01:34:02.078546 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 01:34:02.614232 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 01:34:02.663631 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:02.677540 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:34:02.746168 tst mo_mt_call.py: using LAC 37626 01:34:02.875456 tst mo_mt_call.py: using RAC 141 01:34:03.005857 tst mo_mt_call.py: using CellId 37626 01:34:03.126643 tst mo_mt_call.py: using BVCI 37627 01:34:03.238267 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:03.249609 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:03.260552 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:03.271659 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:03.283489 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:03.295038 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:34:03.416358 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:34:03.534763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:34:04.006260 run create_hlr_db(pid=24451): Launched 01:34:04.133679 bus /sierra_2: Setting Powered False 01:34:05.194693 run create_hlr_db(pid=24451): Terminated: ok {rc=0} 01:34:05.641569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24453): Launched 01:34:05.970395 run osmo-hlr_10.42.42.2(pid=24454): Launched 01:34:06.096533 run osmo-stp_10.42.42.5: Starting osmo-stp 01:34:06.660604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24456): Launched 01:34:06.989390 run osmo-stp_10.42.42.5(pid=24457): Launched 01:34:07.115498 run osmo-msc_10.42.42.6: Starting osmo-msc 01:34:07.707503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24459): Launched 01:34:08.038648 run osmo-msc_10.42.42.6(pid=24460): Launched 01:34:08.222419 run osmo-stp_10.42.42.5(pid=24457): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24457)] 01:34:08.359455 run osmo-stp_10.42.42.5(pid=24457): stdout: | (launched: 2022-12-14_01:34:06.928410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:08.498024 run osmo-stp_10.42.42.5(pid=24457): stderr: | [0;m[38;5;43m20221214013407123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013407123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013407123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013407124 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013407124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013407124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013407124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:08.634479 run osmo-stp_10.42.42.5(pid=24457): stdout: | (launched: 2022-12-14_01:34:06.928410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:08.764216 run osmo-stp_10.42.42.5(pid=24457): stderr: | [0;m[38;5;43m20221214013407123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013407123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013407123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013407124 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013407124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013407124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013407124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:08.919837 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24457): Process ended prematurely: osmo-stp_10.42.42.5(pid=24457) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24457)] [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 01:34:08.929782 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:34:08.957774 run osmo-hlr_10.42.42.2(pid=24454): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24454)] 01:34:09.008189 run osmo-hlr_10.42.42.2(pid=24454): stdout: | (launched: 2022-12-14_01:34:05.909723) 01:34:09.059826 run osmo-hlr_10.42.42.2(pid=24454): stderr: | [0;m[1;31m20221214013406109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013406109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013406109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013406109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013406109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013406109 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013406121 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013406129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013406129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013406129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:34:09.132333 run osmo-msc_10.42.42.6(pid=24460): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24460)] 01:34:09.181694 run osmo-msc_10.42.42.6(pid=24460): stdout: | (launched: 2022-12-14_01:34:07.977545) 01:34:09.233339 run osmo-msc_10.42.42.6(pid=24460): stderr: | [0;m[38;5;43m20221214013408300 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214013408301 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f13831edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214013408301 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214013408301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214013408301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214013408301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214013408303 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214013408303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214013408303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214013408303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:34:09.285135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24453): Terminating (SIGTERM) 01:34:09.327109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24456): Terminating (SIGTERM) 01:34:09.368734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24459): Terminating (SIGTERM) 01:34:09.411383 --- ParallelTerminationStrategy: PID 24453 died... 01:34:09.431846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24453): Terminated: ok {rc=0} 01:34:09.477984 --- ParallelTerminationStrategy: PID 24456 died... 01:34:09.498029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24456): Terminated: ok {rc=0} 01:34:09.543999 --- ParallelTerminationStrategy: PID 24459 died... 01:34:09.564004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24459): Terminated: ok {rc=0} 01:34:09.651809 bus /sierra_3: Setting Powered False 01:34:10.750409 bus /sierra_3: Setting Powered False 01:34:11.866789 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 01:34:13.012542 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:13.024810 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:34:13.090452 tst mo_mt_call_osmux.py: using LAC 37627 01:34:13.209112 tst mo_mt_call_osmux.py: using RAC 142 01:34:13.327432 tst mo_mt_call_osmux.py: using CellId 37627 01:34:13.447903 tst mo_mt_call_osmux.py: using BVCI 37628 01:34:13.558319 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:13.569795 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:13.580995 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:13.592110 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:13.603353 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:34:13.614548 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:34:13.730829 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:34:13.849534 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:34:14.323447 run create_hlr_db(pid=24462): Launched 01:34:14.447045 bus /sierra_2: Setting Powered False 01:34:15.508088 run create_hlr_db(pid=24462): Terminated: ok {rc=0} 01:34:15.981766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24464): Launched 01:34:16.313609 run osmo-hlr_10.42.42.2(pid=24465): Launched 01:34:16.584926 run osmo-stp_10.42.42.5: Starting osmo-stp 01:34:17.241696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24467): Launched 01:34:17.571479 run osmo-stp_10.42.42.5(pid=24468): Launched 01:34:17.695226 run osmo-msc_10.42.42.6: Starting osmo-msc 01:34:18.286422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24470): Launched 01:34:18.614257 run osmo-msc_10.42.42.6(pid=24471): Launched 01:34:18.796564 run osmo-stp_10.42.42.5(pid=24468): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24468)] 01:34:18.933786 run osmo-stp_10.42.42.5(pid=24468): stdout: | (launched: 2022-12-14_01:34:17.510203) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:19.071524 run osmo-stp_10.42.42.5(pid=24468): stderr: | [0;m[38;5;43m20221214013417703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013417703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013417704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013417704 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013417705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013417705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013417705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:19.208104 run osmo-stp_10.42.42.5(pid=24468): stdout: | (launched: 2022-12-14_01:34:17.510203) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:19.337809 run osmo-stp_10.42.42.5(pid=24468): stderr: | [0;m[38;5;43m20221214013417703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013417703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013417704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013417704 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013417705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013417705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013417705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:19.493124 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24468): Process ended prematurely: osmo-stp_10.42.42.5(pid=24468) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24468)] [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 01:34:19.503142 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 01:34:19.530949 run osmo-hlr_10.42.42.2(pid=24465): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24465)] 01:34:19.581168 run osmo-hlr_10.42.42.2(pid=24465): stdout: | (launched: 2022-12-14_01:34:16.254313) 01:34:19.632405 run osmo-hlr_10.42.42.2(pid=24465): stderr: | [0;m[1;31m20221214013416536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013416536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013416536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013416536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013416536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013416536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013416555 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013416568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013416568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013416568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:34:19.704411 run osmo-msc_10.42.42.6(pid=24471): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24471)] 01:34:19.753628 run osmo-msc_10.42.42.6(pid=24471): stdout: | (launched: 2022-12-14_01:34:18.553512) 01:34:19.804809 run osmo-msc_10.42.42.6(pid=24471): stderr: | [0;m[38;5;43m20221214013418874 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214013418874 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fad961f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214013418874 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214013418875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214013418875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214013418875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214013418877 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214013418877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214013418877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214013418877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:34:19.856219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24464): Terminating (SIGTERM) 01:34:19.898220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24467): Terminating (SIGTERM) 01:34:19.939761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24470): Terminating (SIGTERM) 01:34:19.981505 --- ParallelTerminationStrategy: PID 24464 died... 01:34:20.001733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24464): Terminated: ok {rc=0} 01:34:20.047826 --- ParallelTerminationStrategy: PID 24467 died... 01:34:20.067669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24467): Terminated: ok {rc=0} 01:34:20.113614 --- ParallelTerminationStrategy: PID 24470 died... 01:34:20.133552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24470): Terminated: ok {rc=0} 01:34:20.221368 bus /sierra_3: Setting Powered False 01:34:21.319441 bus /sierra_3: Setting Powered False 01:34:22.434429 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 01:34:23.683519 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:34:23.690735 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 01:34:23.720583 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 01:34:23.749139 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 01:34:23.801077 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 01:34:23.831538 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 01:34:23.859397 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 01:34:24.409965 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 01:34:24.465586 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:24.477582 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:34:24.543570 tst mo_mt_call.py: using LAC 37628 01:34:24.670394 tst mo_mt_call.py: using RAC 143 01:34:24.796305 tst mo_mt_call.py: using CellId 37628 01:34:24.922351 tst mo_mt_call.py: using BVCI 37629 01:34:25.042720 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:25.054653 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:25.066354 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:25.077945 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:25.090142 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:25.102325 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:34:25.218907 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:34:25.339690 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:34:25.845511 run create_hlr_db(pid=24476): Launched 01:34:25.970517 bus /sierra_2: Setting Powered False 01:34:27.035187 run create_hlr_db(pid=24476): Terminated: ok {rc=0} 01:34:27.493512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24478): Launched 01:34:27.826485 run osmo-hlr_10.42.42.2(pid=24479): Launched 01:34:27.951618 run osmo-stp_10.42.42.5: Starting osmo-stp 01:34:28.518683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24481): Launched 01:34:28.845935 run osmo-stp_10.42.42.5(pid=24482): Launched 01:34:28.971803 run osmo-msc_10.42.42.6: Starting osmo-msc 01:34:29.567499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24484): Launched 01:34:29.897749 run osmo-msc_10.42.42.6(pid=24485): Launched 01:34:30.080316 run osmo-stp_10.42.42.5(pid=24482): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24482)] 01:34:30.217998 run osmo-stp_10.42.42.5(pid=24482): stdout: | (launched: 2022-12-14_01:34:28.785321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:30.356256 run osmo-stp_10.42.42.5(pid=24482): stderr: | [0;m[38;5;43m20221214013428979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013428979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013428979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013428980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013428980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013428980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013428980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:30.494014 run osmo-stp_10.42.42.5(pid=24482): stdout: | (launched: 2022-12-14_01:34:28.785321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:30.624537 run osmo-stp_10.42.42.5(pid=24482): stderr: | [0;m[38;5;43m20221214013428979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013428979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013428979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013428980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013428980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013428980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013428980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:30.780727 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24482): Process ended prematurely: osmo-stp_10.42.42.5(pid=24482) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24482)] [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 01:34:30.790708 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 01:34:30.818683 run osmo-hlr_10.42.42.2(pid=24479): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24479)] 01:34:30.889650 run osmo-hlr_10.42.42.2(pid=24479): stdout: | (launched: 2022-12-14_01:34:27.764793) 01:34:30.963074 run osmo-hlr_10.42.42.2(pid=24479): stderr: | [0;m[1;31m20221214013427966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013427966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013427966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013427966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013427966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013427966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013427978 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013427986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013427986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013427986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:34:31.042052 run osmo-msc_10.42.42.6(pid=24485): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24485)] 01:34:31.092752 run osmo-msc_10.42.42.6(pid=24485): stdout: | (launched: 2022-12-14_01:34:29.836827) 01:34:31.145598 run osmo-msc_10.42.42.6(pid=24485): stderr: | [0;m[38;5;43m20221214013430156 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214013430156 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f742c4c9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214013430156 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214013430157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214013430157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214013430157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214013430159 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214013430159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214013430159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214013430159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:34:31.198535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24478): Terminating (SIGTERM) 01:34:31.241642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24481): Terminating (SIGTERM) 01:34:31.285732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24484): Terminating (SIGTERM) 01:34:31.329470 --- ParallelTerminationStrategy: PID 24478 died... 01:34:31.350113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24478): Terminated: ok {rc=0} 01:34:31.397582 --- ParallelTerminationStrategy: PID 24481 died... 01:34:31.420427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24481): Terminated: ok {rc=0} 01:34:31.479283 --- ParallelTerminationStrategy: PID 24484 died... 01:34:31.503488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24484): Terminated: ok {rc=0} 01:34:31.594944 bus /sierra_3: Setting Powered False 01:34:32.697600 bus /sierra_3: Setting Powered False 01:34:33.813908 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 01:34:34.958198 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:34.970376 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:34:35.036305 tst mo_mt_call_osmux.py: using LAC 37629 01:34:35.156243 tst mo_mt_call_osmux.py: using RAC 144 01:34:35.277311 tst mo_mt_call_osmux.py: using CellId 37629 01:34:35.396398 tst mo_mt_call_osmux.py: using BVCI 37630 01:34:35.506778 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:35.518238 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:35.529448 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:35.540572 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:35.551925 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:34:35.563200 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:34:35.683270 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:34:35.800756 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:34:36.275398 run create_hlr_db(pid=24487): Launched 01:34:36.398927 bus /sierra_2: Setting Powered False 01:34:37.459806 run create_hlr_db(pid=24487): Terminated: ok {rc=0} 01:34:37.907332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24489): Launched 01:34:38.234286 run osmo-hlr_10.42.42.2(pid=24490): Launched 01:34:38.360411 run osmo-stp_10.42.42.5: Starting osmo-stp 01:34:38.923018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24492): Launched 01:34:39.232755 run osmo-stp_10.42.42.5(pid=24493): Launched 01:34:39.350176 run osmo-msc_10.42.42.6: Starting osmo-msc 01:34:39.903930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24495): Launched 01:34:40.210717 run osmo-msc_10.42.42.6(pid=24496): Launched 01:34:40.382295 run osmo-stp_10.42.42.5(pid=24493): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24493)] 01:34:40.510116 run osmo-stp_10.42.42.5(pid=24493): stdout: | (launched: 2022-12-14_01:34:39.175957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:40.637891 run osmo-stp_10.42.42.5(pid=24493): stderr: | [0;m[38;5;43m20221214013439350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013439350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013439350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013439351 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013439351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013439351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013439351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:40.764772 run osmo-stp_10.42.42.5(pid=24493): stdout: | (launched: 2022-12-14_01:34:39.175957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:40.885535 run osmo-stp_10.42.42.5(pid=24493): stderr: | [0;m[38;5;43m20221214013439350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013439350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013439350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013439351 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013439351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013439351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013439351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:41.030228 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24493): Process ended prematurely: osmo-stp_10.42.42.5(pid=24493) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24493)] [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 01:34:41.039308 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:34:41.065830 run osmo-hlr_10.42.42.2(pid=24490): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24490)] 01:34:41.113101 run osmo-hlr_10.42.42.2(pid=24490): stdout: | (launched: 2022-12-14_01:34:38.173680) 01:34:41.162143 run osmo-hlr_10.42.42.2(pid=24490): stderr: | [0;m[1;31m20221214013438372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013438372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013438372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013438372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013438372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013438372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013438387 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013438397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013438397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013438397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:34:41.230260 run osmo-msc_10.42.42.6(pid=24496): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24496)] 01:34:41.277082 run osmo-msc_10.42.42.6(pid=24496): stdout: | (launched: 2022-12-14_01:34:40.152553) 01:34:41.325660 run osmo-msc_10.42.42.6(pid=24496): stderr: | [0;m[38;5;43m20221214013440426 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214013440426 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb943319c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214013440426 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214013440426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214013440426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214013440426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214013440428 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214013440428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214013440429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214013440429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:34:41.374506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24489): Terminating (SIGTERM) 01:34:41.413987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24492): Terminating (SIGTERM) 01:34:41.453202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24495): Terminating (SIGTERM) 01:34:41.492857 --- ParallelTerminationStrategy: PID 24489 died... 01:34:41.512149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24489): Terminated: ok {rc=0} 01:34:41.555670 --- ParallelTerminationStrategy: PID 24492 died... 01:34:41.574454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24492): Terminated: ok {rc=0} 01:34:41.617725 --- ParallelTerminationStrategy: PID 24495 died... 01:34:41.636449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24495): Terminated: ok {rc=0} 01:34:41.721961 bus /sierra_3: Setting Powered False 01:34:42.819695 bus /sierra_3: Setting Powered False 01:34:43.934316 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 01:34:45.178454 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:34:45.184648 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 01:34:45.213658 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 01:34:45.240177 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 01:34:45.291964 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 01:34:45.322113 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 01:34:45.350055 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 01:34:45.933475 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 01:34:45.990053 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:46.002911 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:34:46.075102 tst mo_mt_call.py: using LAC 37630 01:34:46.217322 tst mo_mt_call.py: using RAC 145 01:34:46.337185 tst mo_mt_call.py: using CellId 37630 01:34:46.465268 tst mo_mt_call.py: using BVCI 37631 01:34:46.586435 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:46.599193 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:46.611766 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:46.624288 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:46.638146 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:46.651539 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:34:46.801802 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:34:46.918838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:34:47.399146 run create_hlr_db(pid=24502): Launched 01:34:47.523910 bus /sierra_2: Setting Powered False 01:34:48.584580 run create_hlr_db(pid=24502): Terminated: ok {rc=0} 01:34:49.008849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24504): Launched 01:34:49.313324 run osmo-hlr_10.42.42.2(pid=24505): Launched 01:34:49.427997 run osmo-stp_10.42.42.5: Starting osmo-stp 01:34:49.945629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24507): Launched 01:34:50.249451 run osmo-stp_10.42.42.5(pid=24508): Launched 01:34:50.363813 run osmo-msc_10.42.42.6: Starting osmo-msc 01:34:50.910116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24510): Launched 01:34:51.212550 run osmo-msc_10.42.42.6(pid=24511): Launched 01:34:51.380350 run osmo-stp_10.42.42.5(pid=24508): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24508)] 01:34:51.507197 run osmo-stp_10.42.42.5(pid=24508): stdout: | (launched: 2022-12-14_01:34:50.192227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:51.633418 run osmo-stp_10.42.42.5(pid=24508): stderr: | [0;m[38;5;43m20221214013450362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013450363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013450363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013450363 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013450364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013450364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013450364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:51.758180 run osmo-stp_10.42.42.5(pid=24508): stdout: | (launched: 2022-12-14_01:34:50.192227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:34:51.876675 run osmo-stp_10.42.42.5(pid=24508): stderr: | [0;m[38;5;43m20221214013450362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013450363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013450363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013450363 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013450364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013450364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013450364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:34:52.019135 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24508): Process ended prematurely: osmo-stp_10.42.42.5(pid=24508) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24508)] [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 01:34:52.028042 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:34:52.054276 run osmo-hlr_10.42.42.2(pid=24505): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24505)] 01:34:52.100939 run osmo-hlr_10.42.42.2(pid=24505): stdout: | (launched: 2022-12-14_01:34:49.255622) 01:34:52.149412 run osmo-hlr_10.42.42.2(pid=24505): stderr: | [0;m[1;31m20221214013449432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013449432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013449432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013449432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013449432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013449432 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013449444 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013449453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013449454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013449454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:34:52.217283 run osmo-msc_10.42.42.6(pid=24511): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24511)] 01:34:52.263846 run osmo-msc_10.42.42.6(pid=24511): stdout: | (launched: 2022-12-14_01:34:51.155328) 01:34:52.312115 run osmo-msc_10.42.42.6(pid=24511): stderr: | [0;m[38;5;43m20221214013451425 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214013451425 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff968367c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214013451425 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214013451425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214013451426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214013451426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214013451427 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214013451428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214013451428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214013451428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:34:52.360700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24504): Terminating (SIGTERM) 01:34:52.399612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24507): Terminating (SIGTERM) 01:34:52.438514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24510): Terminating (SIGTERM) 01:34:52.477640 --- ParallelTerminationStrategy: PID 24504 died... 01:34:52.496519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24504): Terminated: ok {rc=0} 01:34:52.539652 --- ParallelTerminationStrategy: PID 24507 died... 01:34:52.558083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24507): Terminated: ok {rc=0} 01:34:52.601352 --- ParallelTerminationStrategy: PID 24510 died... 01:34:52.619832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24510): Terminated: ok {rc=0} 01:34:52.701760 bus /sierra_3: Setting Powered False 01:34:53.798414 bus /sierra_3: Setting Powered False 01:34:54.914863 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 01:34:56.056191 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:56.068212 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 01:34:56.134102 tst mo_mt_call_osmux.py: using LAC 37631 01:34:56.259252 tst mo_mt_call_osmux.py: using RAC 146 01:34:56.385748 tst mo_mt_call_osmux.py: using CellId 37631 01:34:56.502257 tst mo_mt_call_osmux.py: using BVCI 37632 01:34:56.612042 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:56.623506 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:56.634681 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:56.645941 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:56.657461 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 01:34:56.668570 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:34:56.784261 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 01:34:56.903540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:34:57.402588 run create_hlr_db(pid=24513): Launched 01:34:57.525820 bus /sierra_2: Setting Powered False 01:34:58.589092 run create_hlr_db(pid=24513): Terminated: ok {rc=0} 01:34:59.020325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24515): Launched 01:34:59.321285 run osmo-hlr_10.42.42.2(pid=24516): Launched 01:34:59.435846 run osmo-stp_10.42.42.5: Starting osmo-stp 01:34:59.950525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24518): Launched 01:35:00.250124 run osmo-stp_10.42.42.5(pid=24519): Launched 01:35:00.363881 run osmo-msc_10.42.42.6: Starting osmo-msc 01:35:00.933978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24521): Launched 01:35:01.274519 run osmo-msc_10.42.42.6(pid=24522): Launched 01:35:01.566033 run osmo-stp_10.42.42.5(pid=24519): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24519)] 01:35:01.845883 run osmo-stp_10.42.42.5(pid=24519): stdout: | (launched: 2022-12-14_01:35:00.194324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:02.196638 run osmo-stp_10.42.42.5(pid=24519): stderr: | [0;m[38;5;43m20221214013500362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013500362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013500363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013500363 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013500364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013500364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013500364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:02.393914 run osmo-stp_10.42.42.5(pid=24519): stdout: | (launched: 2022-12-14_01:35:00.194324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:02.524165 run osmo-stp_10.42.42.5(pid=24519): stderr: | [0;m[38;5;43m20221214013500362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013500362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013500363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013500363 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013500364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013500364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013500364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:02.678112 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24519): Process ended prematurely: osmo-stp_10.42.42.5(pid=24519) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24519)] [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 01:35:02.687797 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 01:35:02.715933 run osmo-hlr_10.42.42.2(pid=24516): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24516)] 01:35:02.766756 run osmo-hlr_10.42.42.2(pid=24516): stdout: | (launched: 2022-12-14_01:34:59.265289) 01:35:02.818694 run osmo-hlr_10.42.42.2(pid=24516): stderr: | [0;m[1;31m20221214013459438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013459438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013459438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013459438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013459438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013459438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013459450 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013459459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013459459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013459460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:35:02.891226 run osmo-msc_10.42.42.6(pid=24522): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24522)] 01:35:02.941385 run osmo-msc_10.42.42.6(pid=24522): stdout: | (launched: 2022-12-14_01:35:01.207233) 01:35:02.993455 run osmo-msc_10.42.42.6(pid=24522): stderr: | [0;m[38;5;43m20221214013501970 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214013501970 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f324e41bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214013501970 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214013501970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214013501971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214013501971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214013501972 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214013501973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214013501973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214013501973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:35:03.045815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24515): Terminating (SIGTERM) 01:35:03.087620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24518): Terminating (SIGTERM) 01:35:03.129620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24521): Terminating (SIGTERM) 01:35:03.171966 --- ParallelTerminationStrategy: PID 24515 died... 01:35:03.192522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24515): Terminated: ok {rc=0} 01:35:03.239099 --- ParallelTerminationStrategy: PID 24518 died... 01:35:03.259422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24518): Terminated: ok {rc=0} 01:35:03.306314 --- ParallelTerminationStrategy: PID 24521 died... 01:35:03.326513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24521): Terminated: ok {rc=0} 01:35:03.414953 bus /sierra_3: Setting Powered False 01:35:04.512659 bus /sierra_3: Setting Powered False 01:35:05.627569 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:35:06.874862 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:35:06.881906 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:35:06.911122 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:35:06.939288 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:35:06.992659 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:35:07.022021 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:35:07.049372 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:35:07.605947 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:35:07.657926 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:07.669710 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:35:07.739690 tst mo_mt_call.py: using LAC 37632 01:35:07.862813 tst mo_mt_call.py: using RAC 147 01:35:07.986938 tst mo_mt_call.py: using CellId 37632 01:35:08.110007 tst mo_mt_call.py: using BVCI 37633 01:35:08.225739 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:08.237590 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:08.249198 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:08.260694 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:08.272787 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:08.284655 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:35:08.400656 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:35:08.517483 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:35:09.007701 run create_hlr_db(pid=24530): Launched 01:35:09.128710 bus /sierra_2: Setting Powered False 01:35:10.191085 run create_hlr_db(pid=24530): Terminated: ok {rc=0} 01:35:10.615122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24532): Launched 01:35:10.910862 run osmo-hlr_10.42.42.2(pid=24533): Launched 01:35:11.023519 run osmo-stp_10.42.42.5: Starting osmo-stp 01:35:11.530616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24535): Launched 01:35:11.825118 run osmo-stp_10.42.42.5(pid=24536): Launched 01:35:11.936072 run osmo-msc_10.42.42.6: Starting osmo-msc 01:35:12.470820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24538): Launched 01:35:12.766025 run osmo-msc_10.42.42.6(pid=24539): Launched 01:35:12.929659 run osmo-stp_10.42.42.5(pid=24536): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24536)] 01:35:13.054426 run osmo-stp_10.42.42.5(pid=24536): stdout: | (launched: 2022-12-14_01:35:11.770184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:13.179393 run osmo-stp_10.42.42.5(pid=24536): stderr: | [0;m[38;5;43m20221214013511937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013511937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013511937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013511938 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013511938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013511938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013511938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:13.301836 run osmo-stp_10.42.42.5(pid=24536): stdout: | (launched: 2022-12-14_01:35:11.770184) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:13.418407 run osmo-stp_10.42.42.5(pid=24536): stderr: | [0;m[38;5;43m20221214013511937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013511937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013511937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013511938 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013511938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013511938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013511938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:13.558052 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24536): Process ended prematurely: osmo-stp_10.42.42.5(pid=24536) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24536)] [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:35:13.566719 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 01:35:13.592533 run osmo-hlr_10.42.42.2(pid=24533): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24533)] 01:35:13.639274 run osmo-hlr_10.42.42.2(pid=24533): stdout: | (launched: 2022-12-14_01:35:10.856100) 01:35:13.687129 run osmo-hlr_10.42.42.2(pid=24533): stderr: | [0;m[1;31m20221214013511026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013511026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013511026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013511026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013511026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013511026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013511038 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013511047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013511047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013511047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:35:13.753909 run osmo-msc_10.42.42.6(pid=24539): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24539)] 01:35:13.799708 run osmo-msc_10.42.42.6(pid=24539): stdout: | (launched: 2022-12-14_01:35:12.710946) 01:35:13.847321 run osmo-msc_10.42.42.6(pid=24539): stderr: | [0;m[38;5;43m20221214013512977 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214013512978 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f089a052c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214013512978 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214013512978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214013512978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214013512978 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214013512980 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214013512980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214013512981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214013512981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:35:13.895488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24532): Terminating (SIGTERM) 01:35:13.934066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24535): Terminating (SIGTERM) 01:35:13.972504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24538): Terminating (SIGTERM) 01:35:14.011297 --- ParallelTerminationStrategy: PID 24532 died... 01:35:14.029920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24532): Terminated: ok {rc=0} 01:35:14.072560 --- ParallelTerminationStrategy: PID 24535 died... 01:35:14.090781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24535): Terminated: ok {rc=0} 01:35:14.133201 --- ParallelTerminationStrategy: PID 24538 died... 01:35:14.151204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24538): Terminated: ok {rc=0} 01:35:14.235001 bus /sierra_3: Setting Powered False 01:35:15.331413 bus /sierra_3: Setting Powered False 01:35:16.443508 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:35:17.593404 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:17.605607 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:35:17.673349 tst mo_mt_call_osmux.py: using LAC 37633 01:35:17.797044 tst mo_mt_call_osmux.py: using RAC 148 01:35:17.914142 tst mo_mt_call_osmux.py: using CellId 37633 01:35:18.029376 tst mo_mt_call_osmux.py: using BVCI 37634 01:35:18.137804 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:18.148783 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:18.159914 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:18.170776 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:18.181789 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:35:18.192554 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:35:18.311606 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:35:18.427033 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:35:18.884224 run create_hlr_db(pid=24541): Launched 01:35:19.006202 bus /sierra_2: Setting Powered False 01:35:20.066870 run create_hlr_db(pid=24541): Terminated: ok {rc=0} 01:35:20.506996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24543): Launched 01:35:20.829643 run osmo-hlr_10.42.42.2(pid=24544): Launched 01:35:20.952015 run osmo-stp_10.42.42.5: Starting osmo-stp 01:35:21.507996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24546): Launched 01:35:21.829606 run osmo-stp_10.42.42.5(pid=24547): Launched 01:35:21.952625 run osmo-msc_10.42.42.6: Starting osmo-msc 01:35:22.534874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24549): Launched 01:35:22.856475 run osmo-msc_10.42.42.6(pid=24550): Launched 01:35:23.034911 run osmo-stp_10.42.42.5(pid=24547): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24547)] 01:35:23.170683 run osmo-stp_10.42.42.5(pid=24547): stdout: | (launched: 2022-12-14_01:35:21.770592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:23.306658 run osmo-stp_10.42.42.5(pid=24547): stderr: | [0;m[38;5;43m20221214013521959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013521959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013521959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013521959 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013521960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013521960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013521960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:23.441314 run osmo-stp_10.42.42.5(pid=24547): stdout: | (launched: 2022-12-14_01:35:21.770592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:23.569558 run osmo-stp_10.42.42.5(pid=24547): stderr: | [0;m[38;5;43m20221214013521959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013521959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013521959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013521959 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013521960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013521960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013521960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:23.722544 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24547): Process ended prematurely: osmo-stp_10.42.42.5(pid=24547) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24547)] [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:35:23.732138 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:35:23.760020 run osmo-hlr_10.42.42.2(pid=24544): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24544)] 01:35:23.810185 run osmo-hlr_10.42.42.2(pid=24544): stdout: | (launched: 2022-12-14_01:35:20.770316) 01:35:23.861468 run osmo-hlr_10.42.42.2(pid=24544): stderr: | [0;m[1;31m20221214013520964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013520964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013520964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013520964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013520964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013520965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013520977 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013520985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013520985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013520985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:35:23.933637 run osmo-msc_10.42.42.6(pid=24550): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24550)] 01:35:23.982917 run osmo-msc_10.42.42.6(pid=24550): stdout: | (launched: 2022-12-14_01:35:22.797200) 01:35:24.034593 run osmo-msc_10.42.42.6(pid=24550): stderr: | [0;m[38;5;43m20221214013523115 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214013523115 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd1c02c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214013523116 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214013523116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214013523116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214013523116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214013523118 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214013523118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214013523118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214013523118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:35:24.086491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24543): Terminating (SIGTERM) 01:35:24.127746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24546): Terminating (SIGTERM) 01:35:24.169262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24549): Terminating (SIGTERM) 01:35:24.211994 --- ParallelTerminationStrategy: PID 24543 died... 01:35:24.232760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24543): Terminated: ok {rc=0} 01:35:24.278768 --- ParallelTerminationStrategy: PID 24546 died... 01:35:24.298630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24546): Terminated: ok {rc=0} 01:35:24.344538 --- ParallelTerminationStrategy: PID 24549 died... 01:35:24.364455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24549): Terminated: ok {rc=0} 01:35:24.451676 bus /sierra_3: Setting Powered False 01:35:25.549481 bus /sierra_3: Setting Powered False 01:35:26.665595 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:35:27.912454 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:35:27.919811 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:35:27.949392 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:35:27.977834 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:35:28.031129 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:35:28.060072 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:35:28.087096 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:35:28.640594 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:35:28.691047 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:28.702361 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:35:28.768827 tst mo_mt_call.py: using LAC 37634 01:35:28.888459 tst mo_mt_call.py: using RAC 149 01:35:29.016071 tst mo_mt_call.py: using CellId 37634 01:35:29.141301 tst mo_mt_call.py: using BVCI 37635 01:35:29.257590 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:29.269620 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:29.281383 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:29.292803 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:29.304696 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:29.316497 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:35:29.435230 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:35:29.550006 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:35:30.013068 run create_hlr_db(pid=24556): Launched 01:35:30.136753 bus /sierra_2: Setting Powered False 01:35:31.198100 run create_hlr_db(pid=24556): Terminated: ok {rc=0} 01:35:31.641802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24558): Launched 01:35:31.967630 run osmo-hlr_10.42.42.2(pid=24559): Launched 01:35:32.205922 run osmo-stp_10.42.42.5: Starting osmo-stp 01:35:32.765619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24561): Launched 01:35:33.093163 run osmo-stp_10.42.42.5(pid=24562): Launched 01:35:33.217094 run osmo-msc_10.42.42.6: Starting osmo-msc 01:35:33.804781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24564): Launched 01:35:34.131213 run osmo-msc_10.42.42.6(pid=24565): Launched 01:35:34.311573 run osmo-stp_10.42.42.5(pid=24562): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24562)] 01:35:34.448329 run osmo-stp_10.42.42.5(pid=24562): stdout: | (launched: 2022-12-14_01:35:33.032300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:34.586623 run osmo-stp_10.42.42.5(pid=24562): stderr: | [0;m[38;5;43m20221214013533222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013533222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013533222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013533222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013533223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013533223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013533223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:34.723095 run osmo-stp_10.42.42.5(pid=24562): stdout: | (launched: 2022-12-14_01:35:33.032300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:34.852453 run osmo-stp_10.42.42.5(pid=24562): stderr: | [0;m[38;5;43m20221214013533222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013533222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013533222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013533222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013533223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013533223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013533223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:35.007316 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24562): Process ended prematurely: osmo-stp_10.42.42.5(pid=24562) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24562)] [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:35:35.017240 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 01:35:35.045624 run osmo-hlr_10.42.42.2(pid=24559): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24559)] 01:35:35.096204 run osmo-hlr_10.42.42.2(pid=24559): stdout: | (launched: 2022-12-14_01:35:31.897961) 01:35:35.148120 run osmo-hlr_10.42.42.2(pid=24559): stderr: | [0;m[1;31m20221214013532128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013532128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013532128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013532128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013532128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013532128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013532151 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013532167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013532168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013532168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:35:35.221508 run osmo-msc_10.42.42.6(pid=24565): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24565)] 01:35:35.271107 run osmo-msc_10.42.42.6(pid=24565): stdout: | (launched: 2022-12-14_01:35:34.070554) 01:35:35.323517 run osmo-msc_10.42.42.6(pid=24565): stderr: | [0;m[38;5;43m20221214013534390 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214013534390 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0cf63f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214013534390 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214013534390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214013534391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214013534391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214013534393 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214013534393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214013534393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214013534393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:35:35.375571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24558): Terminating (SIGTERM) 01:35:35.417501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24561): Terminating (SIGTERM) 01:35:35.459422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24564): Terminating (SIGTERM) 01:35:35.502031 --- ParallelTerminationStrategy: PID 24558 died... 01:35:35.522533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24558): Terminated: ok {rc=0} 01:35:35.569351 --- ParallelTerminationStrategy: PID 24561 died... 01:35:35.589471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24561): Terminated: ok {rc=0} 01:35:35.635632 --- ParallelTerminationStrategy: PID 24564 died... 01:35:35.655682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24564): Terminated: ok {rc=0} 01:35:35.743563 bus /sierra_3: Setting Powered False 01:35:36.838274 bus /sierra_3: Setting Powered False 01:35:37.951116 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:35:39.099512 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:39.112389 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:35:39.181735 tst mo_mt_call_osmux.py: using LAC 37635 01:35:39.309978 tst mo_mt_call_osmux.py: using RAC 150 01:35:39.437466 tst mo_mt_call_osmux.py: using CellId 37635 01:35:39.564689 tst mo_mt_call_osmux.py: using BVCI 37636 01:35:39.681883 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:39.694029 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:39.705768 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:39.717445 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:39.729535 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:35:39.741484 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:35:39.858438 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:35:39.974446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:35:40.443505 run create_hlr_db(pid=24567): Launched 01:35:40.567101 bus /sierra_2: Setting Powered False 01:35:41.627276 run create_hlr_db(pid=24567): Terminated: ok {rc=0} 01:35:42.093407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24569): Launched 01:35:42.417430 run osmo-hlr_10.42.42.2(pid=24570): Launched 01:35:42.541312 run osmo-stp_10.42.42.5: Starting osmo-stp 01:35:43.097991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24572): Launched 01:35:43.421705 run osmo-stp_10.42.42.5(pid=24573): Launched 01:35:43.544525 run osmo-msc_10.42.42.6: Starting osmo-msc 01:35:44.127635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24575): Launched 01:35:44.450789 run osmo-msc_10.42.42.6(pid=24576): Launched 01:35:44.630362 run osmo-stp_10.42.42.5(pid=24573): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24573)] 01:35:44.766393 run osmo-stp_10.42.42.5(pid=24573): stdout: | (launched: 2022-12-14_01:35:43.361983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:44.902806 run osmo-stp_10.42.42.5(pid=24573): stderr: | [0;m[38;5;43m20221214013543552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013543552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013543552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013543552 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013543553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013543553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013543553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:45.037671 run osmo-stp_10.42.42.5(pid=24573): stdout: | (launched: 2022-12-14_01:35:43.361983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:45.166049 run osmo-stp_10.42.42.5(pid=24573): stderr: | [0;m[38;5;43m20221214013543552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013543552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013543552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013543552 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013543553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013543553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013543553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:45.319796 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24573): Process ended prematurely: osmo-stp_10.42.42.5(pid=24573) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24573)] [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:35:45.329689 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:35:45.357604 run osmo-hlr_10.42.42.2(pid=24570): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24570)] 01:35:45.408120 run osmo-hlr_10.42.42.2(pid=24570): stdout: | (launched: 2022-12-14_01:35:42.357355) 01:35:45.459806 run osmo-hlr_10.42.42.2(pid=24570): stderr: | [0;m[1;31m20221214013542552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013542552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013542552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013542552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013542552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013542552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013542568 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013542578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013542578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013542578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:35:45.532211 run osmo-msc_10.42.42.6(pid=24576): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24576)] 01:35:45.581836 run osmo-msc_10.42.42.6(pid=24576): stdout: | (launched: 2022-12-14_01:35:44.390833) 01:35:45.633770 run osmo-msc_10.42.42.6(pid=24576): stderr: | [0;m[38;5;43m20221214013544709 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214013544709 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe45893fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214013544709 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214013544709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214013544709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214013544709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214013544711 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214013544711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214013544711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214013544712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:35:45.685667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24569): Terminating (SIGTERM) 01:35:45.727348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24572): Terminating (SIGTERM) 01:35:45.769031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24575): Terminating (SIGTERM) 01:35:45.811344 --- ParallelTerminationStrategy: PID 24569 died... 01:35:45.835582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24569): Terminated: ok {rc=0} 01:35:45.884870 --- ParallelTerminationStrategy: PID 24572 died... 01:35:45.906800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24572): Terminated: ok {rc=0} 01:35:45.961873 --- ParallelTerminationStrategy: PID 24575 died... 01:35:45.982481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24575): Terminated: ok {rc=0} 01:35:46.075234 bus /sierra_3: Setting Powered False 01:35:47.177516 bus /sierra_3: Setting Powered False 01:35:48.294966 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:35:49.550874 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:35:49.557225 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:35:49.586712 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 01:35:49.614251 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 01:35:49.667771 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:35:49.697833 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 01:35:49.725340 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 01:35:50.274609 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 01:35:50.324229 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:35:50.335481 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:35:50.404903 tst mo_mt_call.py: using LAC 37636 01:35:50.521703 tst mo_mt_call.py: using RAC 151 01:35:50.638016 tst mo_mt_call.py: using CellId 37636 01:35:50.753505 tst mo_mt_call.py: using BVCI 37637 01:35:50.861649 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:35:50.872576 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:35:50.883446 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:35:50.894279 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:35:50.905168 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:35:50.915922 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:35:51.029370 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:35:51.149275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:35:51.615986 run create_hlr_db(pid=24581): Launched 01:35:51.741051 bus /sierra_2: Setting Powered False 01:35:52.805102 run create_hlr_db(pid=24581): Terminated: ok {rc=0} 01:35:53.234105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24585): Launched 01:35:53.536295 run osmo-hlr_10.42.42.2(pid=24586): Launched 01:35:53.649635 run osmo-stp_10.42.42.5: Starting osmo-stp 01:35:54.185617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24588): Launched 01:35:54.487899 run osmo-stp_10.42.42.5(pid=24589): Launched 01:35:54.601813 run osmo-msc_10.42.42.6: Starting osmo-msc 01:35:55.144748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24591): Launched 01:35:55.447020 run osmo-msc_10.42.42.6(pid=24592): Launched 01:35:55.613975 run osmo-stp_10.42.42.5(pid=24589): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24589)] 01:35:55.739571 run osmo-stp_10.42.42.5(pid=24589): stdout: | (launched: 2022-12-14_01:35:54.431462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:55.866346 run osmo-stp_10.42.42.5(pid=24589): stderr: | [0;m[38;5;43m20221214013554599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013554599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013554599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013554600 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013554600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013554600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013554601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:55.990968 run osmo-stp_10.42.42.5(pid=24589): stdout: | (launched: 2022-12-14_01:35:54.431462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:35:56.110535 run osmo-stp_10.42.42.5(pid=24589): stderr: | [0;m[38;5;43m20221214013554599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013554599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013554599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013554600 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013554600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013554600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013554601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:35:56.253891 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24589): Process ended prematurely: osmo-stp_10.42.42.5(pid=24589) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24589)] [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 01:35:56.262910 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 01:35:56.289494 run osmo-hlr_10.42.42.2(pid=24586): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24586)] 01:35:56.336493 run osmo-hlr_10.42.42.2(pid=24586): stdout: | (launched: 2022-12-14_01:35:53.480276) 01:35:56.385114 run osmo-hlr_10.42.42.2(pid=24586): stderr: | [0;m[1;31m20221214013553654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013553654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013553654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013553654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013553654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013553654 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013553666 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013553676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013553676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013553676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:35:56.452408 run osmo-msc_10.42.42.6(pid=24592): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24592)] 01:35:56.498914 run osmo-msc_10.42.42.6(pid=24592): stdout: | (launched: 2022-12-14_01:35:55.390724) 01:35:56.547119 run osmo-msc_10.42.42.6(pid=24592): stderr: | [0;m[38;5;43m20221214013555659 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214013555659 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f38c5c84c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214013555660 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214013555660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214013555660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214013555660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214013555662 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214013555663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214013555663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214013555663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:35:56.595635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24585): Terminating (SIGTERM) 01:35:56.634432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24588): Terminating (SIGTERM) 01:35:56.673241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24591): Terminating (SIGTERM) 01:35:56.712507 --- ParallelTerminationStrategy: PID 24585 died... 01:35:56.731569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24585): Terminated: ok {rc=0} 01:35:56.774515 --- ParallelTerminationStrategy: PID 24588 died... 01:35:56.792754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24588): Terminated: ok {rc=0} 01:35:56.835858 --- ParallelTerminationStrategy: PID 24591 died... 01:35:56.854365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24591): Terminated: ok {rc=0} 01:35:56.938671 bus /sierra_3: Setting Powered False 01:35:58.035596 bus /sierra_3: Setting Powered False 01:35:59.148115 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 01:36:00.292062 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:36:00.303924 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:36:00.369787 tst mo_mt_call_osmux.py: using LAC 37637 01:36:00.489517 tst mo_mt_call_osmux.py: using RAC 152 01:36:00.605697 tst mo_mt_call_osmux.py: using CellId 37637 01:36:00.724679 tst mo_mt_call_osmux.py: using BVCI 37638 01:36:00.835579 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:36:00.847809 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:36:00.859478 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:36:00.871060 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:36:00.883034 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 01:36:00.895553 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:36:01.029810 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 01:36:01.171921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:36:01.710326 run create_hlr_db(pid=24594): Launched 01:36:01.873004 bus /sierra_2: Setting Powered False 01:36:02.935680 run create_hlr_db(pid=24594): Terminated: ok {rc=0} 01:36:03.369640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24596): Launched 01:36:03.673269 run osmo-hlr_10.42.42.2(pid=24597): Launched 01:36:03.797768 run osmo-stp_10.42.42.5: Starting osmo-stp 01:36:04.358266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24599): Launched 01:36:04.682190 run osmo-stp_10.42.42.5(pid=24600): Launched 01:36:04.804568 run osmo-msc_10.42.42.6: Starting osmo-msc 01:36:05.386593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24602): Launched 01:36:05.710915 run osmo-msc_10.42.42.6(pid=24603): Launched 01:36:05.889917 run osmo-stp_10.42.42.5(pid=24600): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24600)] 01:36:06.025334 run osmo-stp_10.42.42.5(pid=24600): stdout: | (launched: 2022-12-14_01:36:04.622455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:06.161790 run osmo-stp_10.42.42.5(pid=24600): stderr: | [0;m[38;5;43m20221214013604810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013604811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013604811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013604811 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013604812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013604812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013604812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:06.296062 run osmo-stp_10.42.42.5(pid=24600): stdout: | (launched: 2022-12-14_01:36:04.622455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:06.424409 run osmo-stp_10.42.42.5(pid=24600): stderr: | [0;m[38;5;43m20221214013604810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013604811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013604811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013604811 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013604812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013604812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013604812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:06.578536 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24600): Process ended prematurely: osmo-stp_10.42.42.5(pid=24600) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24600)] [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 01:36:06.588149 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:36:06.615834 run osmo-hlr_10.42.42.2(pid=24597): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24597)] 01:36:06.665527 run osmo-hlr_10.42.42.2(pid=24597): stdout: | (launched: 2022-12-14_01:36:03.616361) 01:36:06.716628 run osmo-hlr_10.42.42.2(pid=24597): stderr: | [0;m[1;31m20221214013603804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013603804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013603804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013603804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013603804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013603805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013603817 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013603825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013603825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013603825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:36:06.788504 run osmo-msc_10.42.42.6(pid=24603): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24603)] 01:36:06.837787 run osmo-msc_10.42.42.6(pid=24603): stdout: | (launched: 2022-12-14_01:36:05.650861) 01:36:06.889311 run osmo-msc_10.42.42.6(pid=24603): stderr: | [0;m[38;5;43m20221214013605970 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214013605970 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe5037c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214013605970 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214013605970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214013605970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214013605970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214013605972 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214013605972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214013605972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214013605973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:36:06.940436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24596): Terminating (SIGTERM) 01:36:06.981820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24599): Terminating (SIGTERM) 01:36:07.023294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24602): Terminating (SIGTERM) 01:36:07.065319 --- ParallelTerminationStrategy: PID 24596 died... 01:36:07.085501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24596): Terminated: ok {rc=0} 01:36:07.131510 --- ParallelTerminationStrategy: PID 24599 died... 01:36:07.151306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24599): Terminated: ok {rc=0} 01:36:07.196907 --- ParallelTerminationStrategy: PID 24602 died... 01:36:07.216665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24602): Terminated: ok {rc=0} 01:36:07.303284 bus /sierra_3: Setting Powered False 01:36:08.400706 bus /sierra_3: Setting Powered False 01:36:09.513912 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 01:36:10.755319 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:36:10.759594 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 01:36:10.788129 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 01:36:10.814733 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 01:36:10.896664 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 01:36:10.925366 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 01:36:10.951405 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 01:36:11.540615 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2397 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 01:36:11.546270 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:11.557992 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:36:11.605146 tst emergency_mo_mt_call.py: using LAC 37638 01:36:11.727283 tst emergency_mo_mt_call.py: using RAC 153 01:36:11.849398 tst emergency_mo_mt_call.py: using CellId 37638 01:36:11.970725 tst emergency_mo_mt_call.py: using BVCI 37639 01:36:12.085708 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:12.097274 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:12.108398 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:12.119480 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:12.131054 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:12.142552 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:12.257362 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:12.374077 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:36:12.834365 run create_hlr_db(pid=24609): Launched 01:36:12.955680 bus /sierra_2: Setting Powered False 01:36:14.015976 run create_hlr_db(pid=24609): Terminated: ok {rc=0} 01:36:14.451587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24611): Launched 01:36:14.770142 run osmo-hlr_10.42.42.2(pid=24612): Launched 01:36:14.891755 run osmo-stp_10.42.42.5: Starting osmo-stp 01:36:15.439570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24614): Launched 01:36:15.757558 run osmo-stp_10.42.42.5(pid=24615): Launched 01:36:15.959785 tst emergency_mo_mt_call.py: using MSISDN 8432 01:36:16.192184 run osmo-msc_10.42.42.6: Starting osmo-msc 01:36:16.802248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24617): Launched 01:36:17.136398 run osmo-msc_10.42.42.6(pid=24618): Launched 01:36:17.390434 run osmo-stp_10.42.42.5(pid=24615): ERR: Terminated: ERROR {rc=1} [trial-2397↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24615)] 01:36:17.517363 run osmo-stp_10.42.42.5(pid=24615): stdout: | (launched: 2022-12-14_01:36:15.698704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:17.642915 run osmo-stp_10.42.42.5(pid=24615): stderr: | [0;m[38;5;43m20221214013615960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013615960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013615960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013615960 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013615961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013615961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013615961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:17.766092 run osmo-stp_10.42.42.5(pid=24615): stdout: | (launched: 2022-12-14_01:36:15.698704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:17.883891 run osmo-stp_10.42.42.5(pid=24615): stderr: | [0;m[38;5;43m20221214013615960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013615960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013615960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013615960 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013615961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013615961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013615961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:18.024842 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=24615): Process ended prematurely: osmo-stp_10.42.42.5(pid=24615) [trial-2397↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24615)] [trial-2397↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 01:36:18.033449 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 01:36:18.059663 run osmo-hlr_10.42.42.2(pid=24612): ERR: Terminated: ERROR {rc=237} [trial-2397↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24612)] 01:36:18.106908 run osmo-hlr_10.42.42.2(pid=24612): stdout: | (launched: 2022-12-14_01:36:14.711377) 01:36:18.155737 run osmo-hlr_10.42.42.2(pid=24612): stderr: | [0;m[1;31m20221214013614905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013614905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013614905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013614905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013614905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013614905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013614917 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013614925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013614925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013614925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:36:18.223929 run osmo-msc_10.42.42.6(pid=24618): ERR: Terminated: ERROR {rc=2} [trial-2397↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24618)] 01:36:18.271072 run osmo-msc_10.42.42.6(pid=24618): stdout: | (launched: 2022-12-14_01:36:17.075691) 01:36:18.319730 run osmo-msc_10.42.42.6(pid=24618): stderr: | [0;m[38;5;43m20221214013617431 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214013617432 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc04ca0dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214013617432 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214013617432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214013617432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214013617432 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214013617434 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214013617434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214013617435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214013617435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:36:18.368843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24611): Terminating (SIGTERM) 01:36:18.408047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24614): Terminating (SIGTERM) 01:36:18.447212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24617): Terminating (SIGTERM) 01:36:18.486854 --- ParallelTerminationStrategy: PID 24611 died... 01:36:18.505963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24611): Terminated: ok {rc=0} 01:36:18.549972 --- ParallelTerminationStrategy: PID 24614 died... 01:36:18.568491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24614): Terminated: ok {rc=0} 01:36:18.612078 --- ParallelTerminationStrategy: PID 24617 died... 01:36:18.630851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24617): Terminated: ok {rc=0} 01:36:18.715931 bus /sierra_3: Setting Powered False 01:36:19.814337 bus /sierra_3: Setting Powered False 01:36:20.928599 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 01:36:22.016725 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:22.028698 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:36:22.078041 tst emergency_preemptive_call.py: using LAC 37639 01:36:22.200587 tst emergency_preemptive_call.py: using RAC 154 01:36:22.322531 tst emergency_preemptive_call.py: using CellId 37639 01:36:22.446466 tst emergency_preemptive_call.py: using BVCI 37640 01:36:22.563870 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:22.575439 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:22.586598 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:22.597614 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:22.609512 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:36:22.621267 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:22.737303 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:22.850625 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:22.971094 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:23.083488 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:36:23.543510 run create_hlr_db(pid=24620): Launched 01:36:23.666629 bus /sierra_2: Setting Powered False 01:36:24.726369 run create_hlr_db(pid=24620): Terminated: ok {rc=0} 01:36:25.163957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24622): Launched 01:36:25.482891 run osmo-hlr_10.42.42.2(pid=24623): Launched 01:36:25.604571 run osmo-stp_10.42.42.5: Starting osmo-stp 01:36:26.157149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24625): Launched 01:36:26.475936 run osmo-stp_10.42.42.5(pid=24626): Launched 01:36:26.605401 tst emergency_preemptive_call.py: using MSISDN 8433 01:36:26.767223 run osmo-msc_10.42.42.6: Starting osmo-msc 01:36:27.337313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24628): Launched 01:36:27.656358 run osmo-msc_10.42.42.6(pid=24629): Launched 01:36:27.834293 run osmo-stp_10.42.42.5(pid=24626): ERR: Terminated: ERROR {rc=1} [trial-2397↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24626)] 01:36:27.969704 run osmo-stp_10.42.42.5(pid=24626): stdout: | (launched: 2022-12-14_01:36:26.416067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:28.104124 run osmo-stp_10.42.42.5(pid=24626): stderr: | [0;m[38;5;43m20221214013626605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013626605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013626606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013626606 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013626606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013626607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013626607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:28.237333 run osmo-stp_10.42.42.5(pid=24626): stdout: | (launched: 2022-12-14_01:36:26.416067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:28.363367 run osmo-stp_10.42.42.5(pid=24626): stderr: | [0;m[38;5;43m20221214013626605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013626605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013626606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013626606 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013626606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013626607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013626607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:28.514295 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=24626): Process ended prematurely: osmo-stp_10.42.42.5(pid=24626) [trial-2397↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24626)] [trial-2397↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 01:36:28.523410 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 01:36:28.550859 run osmo-hlr_10.42.42.2(pid=24623): ERR: Terminated: ERROR {rc=237} [trial-2397↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24623)] 01:36:28.601185 run osmo-hlr_10.42.42.2(pid=24623): stdout: | (launched: 2022-12-14_01:36:25.424167) 01:36:28.652635 run osmo-hlr_10.42.42.2(pid=24623): stderr: | [0;m[1;31m20221214013625617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013625617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013625617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013625617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013625617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013625617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013625629 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013625638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013625638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013625638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:36:28.724832 run osmo-msc_10.42.42.6(pid=24629): ERR: Terminated: ERROR {rc=2} [trial-2397↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24629)] 01:36:28.774056 run osmo-msc_10.42.42.6(pid=24629): stdout: | (launched: 2022-12-14_01:36:27.596480) 01:36:28.825439 run osmo-msc_10.42.42.6(pid=24629): stderr: | [0;m[38;5;43m20221214013627913 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214013627913 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7a0e680c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214013627913 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214013627913 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214013627914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214013627914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214013627916 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214013627916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214013627916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214013627916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:36:28.877223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24622): Terminating (SIGTERM) 01:36:28.918690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24625): Terminating (SIGTERM) 01:36:28.960319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24628): Terminating (SIGTERM) 01:36:29.002742 --- ParallelTerminationStrategy: PID 24622 died... 01:36:29.022804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24622): Terminated: ok {rc=0} 01:36:29.069122 --- ParallelTerminationStrategy: PID 24625 died... 01:36:29.088777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24625): Terminated: ok {rc=0} 01:36:29.134542 --- ParallelTerminationStrategy: PID 24628 died... 01:36:29.154194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24628): Terminated: ok {rc=0} 01:36:29.241946 bus /sierra_9: Setting Powered False 01:36:30.339021 bus /sierra_9: Setting Powered False 01:36:31.464918 bus /sierra_8: Setting Powered False 01:36:32.574407 bus /sierra_8: Setting Powered False 01:36:33.686136 bus /sierra_3: Setting Powered False 01:36:34.782723 bus /sierra_3: Setting Powered False 01:36:35.900512 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 01:36:37.168355 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:36:37.172716 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 01:36:37.201199 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 01:36:37.239041 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 01:36:37.322832 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 01:36:37.351256 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 01:36:37.388899 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 01:36:37.982579 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 01:36:38.031303 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:38.042172 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:36:38.085257 tst cs_paging_gprs_active.py: using LAC 37640 01:36:38.201483 tst cs_paging_gprs_active.py: using RAC 155 01:36:38.323950 tst cs_paging_gprs_active.py: using CellId 37640 01:36:38.441017 tst cs_paging_gprs_active.py: using BVCI 37641 01:36:38.549395 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:38.560130 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:38.570729 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:38.581706 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:38.592295 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:38.603160 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:38.613797 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:38.624088 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:38.635190 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:38.755345 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:38.869551 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:36:39.071515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:36:39.374707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24634): Launched 01:36:39.638134 run iperf3-srv_10.42.42.10(pid=24635): Launched 01:36:39.751744 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:36:39.953336 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:36:40.256640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24636): Launched 01:36:40.519916 run iperf3-srv_10.42.42.10(pid=24637): Launched 01:36:40.632694 tst cs_paging_gprs_active.py:38: start network... 01:36:40.833593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:36:41.298043 run create_hlr_db(pid=24638): Launched 01:36:41.420322 bus /sierra_2: Setting Powered False 01:36:42.481156 run create_hlr_db(pid=24638): Terminated: ok {rc=0} 01:36:42.922111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24640): Launched 01:36:43.246311 run osmo-hlr_10.42.42.2(pid=24641): Launched 01:36:43.369366 run osmo-stp_10.42.42.5: Starting osmo-stp 01:36:43.928691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24643): Launched 01:36:44.252300 run osmo-stp_10.42.42.5(pid=24644): Launched 01:36:44.375953 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:36:44.935352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24646): Launched 01:36:45.061752 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:36:45.335540 run patchelf(pid=24647): Launched 01:36:45.515659 run osmo-stp_10.42.42.5(pid=24644): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24644)] 01:36:45.652695 run osmo-stp_10.42.42.5(pid=24644): stdout: | (launched: 2022-12-14_01:36:44.192450) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:45.791594 run osmo-stp_10.42.42.5(pid=24644): stderr: | [0;m[38;5;43m20221214013644383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013644383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013644383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013644383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013644384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013644384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013644384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:45.945942 run osmo-stp_10.42.42.5(pid=24644): stdout: | (launched: 2022-12-14_01:36:44.192450) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:46.100430 run osmo-stp_10.42.42.5(pid=24644): stderr: | [0;m[38;5;43m20221214013644383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013644383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013644383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013644383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013644384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013644384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013644384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:46.301711 run patchelf(pid=24647): Terminating (SIGINT) 01:36:46.530165 run patchelf(pid=24647): Terminated: ok {rc=0} 01:36:46.655933 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24644): Process ended prematurely: osmo-stp_10.42.42.5(pid=24644) [trial-2397↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24644)] [trial-2397↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 01:36:46.666875 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 01:36:46.695684 run osmo-hlr_10.42.42.2(pid=24641): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24641)] 01:36:46.745721 run osmo-hlr_10.42.42.2(pid=24641): stdout: | (launched: 2022-12-14_01:36:43.186377) 01:36:46.801503 run osmo-hlr_10.42.42.2(pid=24641): stderr: | [0;m[1;31m20221214013643382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013643382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013643382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013643382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013643382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013643382 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013643401 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013643411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013643411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013643411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:36:46.866421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24634): Terminating (SIGTERM) 01:36:46.921660 run iperf3-srv_10.42.42.10(pid=24635): Terminating (SIGTERM) 01:36:46.977265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24636): Terminating (SIGTERM) 01:36:47.018577 run iperf3-srv_10.42.42.10(pid=24637): Terminating (SIGTERM) 01:36:47.059232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24640): Terminating (SIGTERM) 01:36:47.100813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24643): Terminating (SIGTERM) 01:36:47.143288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24646): Terminating (SIGTERM) 01:36:47.186459 --- ParallelTerminationStrategy: PID 24634 died... 01:36:47.206327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24634): Terminated: ok {rc=0} 01:36:47.252423 --- ParallelTerminationStrategy: PID 24635 died... 01:36:47.272846 run iperf3-srv_10.42.42.10(pid=24635): Terminated {rc=256} 01:36:47.318423 --- ParallelTerminationStrategy: PID 24636 died... 01:36:47.337696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24636): Terminated: ok {rc=0} 01:36:47.381201 --- ParallelTerminationStrategy: PID 24637 died... 01:36:47.399716 run iperf3-srv_10.42.42.10(pid=24637): Terminated {rc=256} 01:36:47.443142 --- ParallelTerminationStrategy: PID 24640 died... 01:36:47.461640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24640): Terminated: ok {rc=0} 01:36:47.506023 --- ParallelTerminationStrategy: PID 24643 died... 01:36:47.524999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24643): Terminated: ok {rc=0} 01:36:47.568537 --- ParallelTerminationStrategy: PID 24646 died... 01:36:47.587321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24646): Terminated: ok {rc=0} 01:36:47.671904 bus /gobi_0: Setting Powered False 01:36:48.770503 bus /gobi_0: Setting Powered False 01:36:49.883758 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 01:36:51.027901 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:51.039292 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:36:51.090369 tst iperf3.py: using LAC 37641 01:36:51.208288 tst iperf3.py: using RAC 156 01:36:51.328190 tst iperf3.py: using CellId 37641 01:36:51.447665 tst iperf3.py: using BVCI 37642 01:36:51.557996 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:51.568813 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:51.579427 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:51.589927 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:51.600315 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:51.610692 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:51.621706 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:51.632259 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:36:51.643020 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:36:51.758004 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:36:51.959573 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:36:52.262790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24648): Launched 01:36:52.525432 run iperf3-srv_10.42.42.10(pid=24649): Launched 01:36:52.638591 tst iperf3.py:8: start network... 01:36:52.840263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:36:53.308202 run create_hlr_db(pid=24650): Launched 01:36:53.430681 bus /gobi_6: Setting Powered False 01:36:54.490634 run create_hlr_db(pid=24650): Terminated: ok {rc=0} 01:36:54.931853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24652): Launched 01:36:55.254747 run osmo-hlr_10.42.42.2(pid=24653): Launched 01:36:55.378476 run osmo-stp_10.42.42.5: Starting osmo-stp 01:36:55.940240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24655): Launched 01:36:56.264117 run osmo-stp_10.42.42.5(pid=24656): Launched 01:36:56.387018 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:36:56.942486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24658): Launched 01:36:57.066357 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:36:57.339395 run patchelf(pid=24659): Launched 01:36:57.519025 run osmo-stp_10.42.42.5(pid=24656): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24656)] 01:36:57.655799 run osmo-stp_10.42.42.5(pid=24656): stdout: | (launched: 2022-12-14_01:36:56.204136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:57.794359 run osmo-stp_10.42.42.5(pid=24656): stderr: | [0;m[38;5;43m20221214013656393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013656393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013656394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013656394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013656394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013656395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013656395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:57.932898 run osmo-stp_10.42.42.5(pid=24656): stdout: | (launched: 2022-12-14_01:36:56.204136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:36:58.064348 run osmo-stp_10.42.42.5(pid=24656): stderr: | [0;m[38;5;43m20221214013656393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013656393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013656394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013656394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013656394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013656395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013656395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:36:58.220248 run patchelf(pid=24659): Terminating (SIGINT) 01:36:58.400029 run patchelf(pid=24659): Terminated: ok {rc=0} 01:36:58.529951 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24656): Process ended prematurely: osmo-stp_10.42.42.5(pid=24656) [trial-2397↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24656)] [trial-2397↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 01:36:58.540253 tst iperf3.py:8: Test FAILED (7.5 sec) 01:36:58.568693 run osmo-hlr_10.42.42.2(pid=24653): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24653)] 01:36:58.618909 run osmo-hlr_10.42.42.2(pid=24653): stdout: | (launched: 2022-12-14_01:36:55.194949) 01:36:58.670350 run osmo-hlr_10.42.42.2(pid=24653): stderr: | [0;m[1;31m20221214013655389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013655389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013655389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013655390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013655390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013655390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013655401 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013655410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013655410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013655410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:36:58.723105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24648): Terminating (SIGTERM) 01:36:58.764676 run iperf3-srv_10.42.42.10(pid=24649): Terminating (SIGTERM) 01:36:58.806806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24652): Terminating (SIGTERM) 01:36:58.848305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24655): Terminating (SIGTERM) 01:36:58.890313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24658): Terminating (SIGTERM) 01:36:58.932285 --- ParallelTerminationStrategy: PID 24648 died... 01:36:58.952703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24648): Terminated: ok {rc=0} 01:36:58.999036 --- ParallelTerminationStrategy: PID 24649 died... 01:36:59.018915 run iperf3-srv_10.42.42.10(pid=24649): Terminated {rc=256} 01:36:59.064912 --- ParallelTerminationStrategy: PID 24652 died... 01:36:59.085015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24652): Terminated: ok {rc=0} 01:36:59.131214 --- ParallelTerminationStrategy: PID 24655 died... 01:36:59.151102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24655): Terminated: ok {rc=0} 01:36:59.197413 --- ParallelTerminationStrategy: PID 24658 died... 01:36:59.217287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24658): Terminated: ok {rc=0} 01:36:59.305502 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 01:37:00.458453 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:00.470262 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:37:00.517311 tst iperf3m4.py: using LAC 37642 01:37:00.644441 tst iperf3m4.py: using RAC 157 01:37:00.770810 tst iperf3m4.py: using CellId 37642 01:37:00.928838 tst iperf3m4.py: using BVCI 37643 01:37:01.053042 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:01.065002 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:01.076721 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:01.088490 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:01.101213 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:01.113689 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:01.126475 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:01.138840 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:01.151415 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:37:01.292067 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:37:01.439894 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:37:01.584730 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:37:01.718624 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:37:01.941784 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:02.279985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24660): Launched 01:37:02.563741 run iperf3-srv_10.42.42.10(pid=24661): Launched 01:37:02.685225 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:37:02.902750 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:03.227317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24662): Launched 01:37:03.508868 run iperf3-srv_10.42.42.10(pid=24663): Launched 01:37:03.630413 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:37:03.846998 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:04.172938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24664): Launched 01:37:04.454632 run iperf3-srv_10.42.42.10(pid=24665): Launched 01:37:04.577495 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:37:04.795449 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:05.120741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24666): Launched 01:37:05.402760 run iperf3-srv_10.42.42.10(pid=24667): Launched 01:37:05.523819 tst iperf3m4.py:8: start network... 01:37:05.741347 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:37:06.242388 run create_hlr_db(pid=24668): Launched 01:37:06.367325 bus /gobi_6: Setting Powered False 01:37:07.430607 run create_hlr_db(pid=24668): Terminated: ok {rc=0} 01:37:07.862385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24670): Launched 01:37:08.165245 run osmo-hlr_10.42.42.2(pid=24671): Launched 01:37:08.279964 run osmo-stp_10.42.42.5: Starting osmo-stp 01:37:08.931007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24673): Launched 01:37:09.226111 run osmo-stp_10.42.42.5(pid=24674): Launched 01:37:09.338082 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:37:09.849138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24676): Launched 01:37:09.963498 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:37:10.212736 run patchelf(pid=24677): Launched 01:37:10.377104 run osmo-stp_10.42.42.5(pid=24674): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24674)] 01:37:10.501994 run osmo-stp_10.42.42.5(pid=24674): stdout: | (launched: 2022-12-14_01:37:09.170771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:10.629303 run osmo-stp_10.42.42.5(pid=24674): stderr: | [0;m[38;5;43m20221214013709337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013709338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013709338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013709338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013709339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013709339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013709339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:10.756108 run osmo-stp_10.42.42.5(pid=24674): stdout: | (launched: 2022-12-14_01:37:09.170771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:10.876462 run osmo-stp_10.42.42.5(pid=24674): stderr: | [0;m[38;5;43m20221214013709337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013709338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013709338 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013709338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013709339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013709339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013709339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:11.018959 run patchelf(pid=24677): Terminating (SIGINT) 01:37:11.184696 run patchelf(pid=24677): Terminated: ok {rc=0} 01:37:11.304502 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24674): Process ended prematurely: osmo-stp_10.42.42.5(pid=24674) [trial-2397↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24674)] [trial-2397↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 01:37:11.314106 tst iperf3m4.py:8: Test FAILED (10.9 sec) 01:37:11.341416 run osmo-hlr_10.42.42.2(pid=24671): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24671)] 01:37:11.388233 run osmo-hlr_10.42.42.2(pid=24671): stdout: | (launched: 2022-12-14_01:37:08.109135) 01:37:11.436673 run osmo-hlr_10.42.42.2(pid=24671): stderr: | [0;m[1;31m20221214013708282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013708282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013708282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013708282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013708282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013708282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013708294 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013708302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013708302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013708302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:37:11.485481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24660): Terminating (SIGTERM) 01:37:11.524396 run iperf3-srv_10.42.42.10(pid=24661): Terminating (SIGTERM) 01:37:11.563046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24662): Terminating (SIGTERM) 01:37:11.601877 run iperf3-srv_10.42.42.10(pid=24663): Terminating (SIGTERM) 01:37:11.640661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24664): Terminating (SIGTERM) 01:37:11.679528 run iperf3-srv_10.42.42.10(pid=24665): Terminating (SIGTERM) 01:37:11.718044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24666): Terminating (SIGTERM) 01:37:11.756753 run iperf3-srv_10.42.42.10(pid=24667): Terminating (SIGTERM) 01:37:11.795442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24670): Terminating (SIGTERM) 01:37:11.834353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24673): Terminating (SIGTERM) 01:37:11.873089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24676): Terminating (SIGTERM) 01:37:11.912468 --- ParallelTerminationStrategy: PID 24660 died... 01:37:11.931623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24660): Terminated: ok {rc=0} 01:37:11.975179 --- ParallelTerminationStrategy: PID 24661 died... 01:37:11.993785 run iperf3-srv_10.42.42.10(pid=24661): Terminated {rc=256} 01:37:12.036831 --- ParallelTerminationStrategy: PID 24662 died... 01:37:12.055813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24662): Terminated: ok {rc=0} 01:37:12.098921 --- ParallelTerminationStrategy: PID 24663 died... 01:37:12.117408 run iperf3-srv_10.42.42.10(pid=24663): Terminated {rc=256} 01:37:12.160312 --- ParallelTerminationStrategy: PID 24664 died... 01:37:12.178862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24664): Terminated: ok {rc=0} 01:37:12.221861 --- ParallelTerminationStrategy: PID 24665 died... 01:37:12.240779 run iperf3-srv_10.42.42.10(pid=24665): Terminated {rc=256} 01:37:12.283842 --- ParallelTerminationStrategy: PID 24666 died... 01:37:12.302109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24666): Terminated: ok {rc=0} 01:37:12.345147 --- ParallelTerminationStrategy: PID 24667 died... 01:37:12.363789 run iperf3-srv_10.42.42.10(pid=24667): Terminated {rc=256} 01:37:12.406822 --- ParallelTerminationStrategy: PID 24670 died... 01:37:12.425480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24670): Terminated: ok {rc=0} 01:37:12.468317 --- ParallelTerminationStrategy: PID 24673 died... 01:37:12.486707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24673): Terminated: ok {rc=0} 01:37:12.529605 --- ParallelTerminationStrategy: PID 24676 died... 01:37:12.548100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24676): Terminated: ok {rc=0} 01:37:12.631996 bus /gobi_4: Setting Powered False 01:37:13.731237 bus /gobi_4: Setting Powered False 01:37:14.844190 bus /gobi_1: Setting Powered False 01:37:15.946798 bus /gobi_1: Setting Powered False 01:37:17.080036 bus /gobi_0: Setting Powered False 01:37:18.178191 bus /gobi_0: Setting Powered False 01:37:19.294129 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 01:37:20.393853 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:20.405194 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:37:20.449396 tst ping.py: using LAC 37643 01:37:20.563611 tst ping.py: using RAC 158 01:37:20.688204 tst ping.py: using CellId 37643 01:37:20.809934 tst ping.py: using BVCI 37644 01:37:20.922964 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:20.934279 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:20.945679 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:20.956898 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:20.968657 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:20.980397 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:20.992224 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:21.003871 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:37:21.122194 tst ping.py:19: start network... 01:37:21.330565 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:37:21.809688 run create_hlr_db(pid=24678): Launched 01:37:21.927922 bus /gobi_6: Setting Powered False 01:37:22.990125 run create_hlr_db(pid=24678): Terminated: ok {rc=0} 01:37:23.408228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24680): Launched 01:37:23.699019 run osmo-hlr_10.42.42.2(pid=24681): Launched 01:37:23.808796 run osmo-stp_10.42.42.5: Starting osmo-stp 01:37:24.310287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24683): Launched 01:37:24.601556 run osmo-stp_10.42.42.5(pid=24684): Launched 01:37:24.712830 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:37:25.216450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24686): Launched 01:37:25.327317 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:37:25.572689 run patchelf(pid=24687): Launched 01:37:25.734149 run osmo-stp_10.42.42.5(pid=24684): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24684)] 01:37:25.856463 run osmo-stp_10.42.42.5(pid=24684): stdout: | (launched: 2022-12-14_01:37:24.546738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:25.981487 run osmo-stp_10.42.42.5(pid=24684): stderr: | [0;m[38;5;43m20221214013724713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013724713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013724713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013724714 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013724714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013724714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013724714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:26.106448 run osmo-stp_10.42.42.5(pid=24684): stdout: | (launched: 2022-12-14_01:37:24.546738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:26.224549 run osmo-stp_10.42.42.5(pid=24684): stderr: | [0;m[38;5;43m20221214013724713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013724713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013724713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013724714 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013724714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013724714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013724714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:26.364832 run patchelf(pid=24687): Terminating (SIGINT) 01:37:26.527227 run patchelf(pid=24687): Terminated: ok {rc=0} 01:37:26.644485 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24684): Process ended prematurely: osmo-stp_10.42.42.5(pid=24684) [trial-2397↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24684)] [trial-2397↪gprs:trx-lms-limenet-micro↪ping.py:22] 01:37:26.653495 tst ping.py:22: Test FAILED (6.3 sec) 01:37:26.679530 run osmo-hlr_10.42.42.2(pid=24681): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24681)] 01:37:26.726420 run osmo-hlr_10.42.42.2(pid=24681): stdout: | (launched: 2022-12-14_01:37:23.645068) 01:37:26.774959 run osmo-hlr_10.42.42.2(pid=24681): stderr: | [0;m[1;31m20221214013723813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013723813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013723813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013723813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013723813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013723814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013723826 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013723835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013723835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013723835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:37:26.823899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24680): Terminating (SIGTERM) 01:37:26.862842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24683): Terminating (SIGTERM) 01:37:26.901972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24686): Terminating (SIGTERM) 01:37:26.941052 --- ParallelTerminationStrategy: PID 24680 died... 01:37:26.959673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24680): Terminated: ok {rc=0} 01:37:27.002626 --- ParallelTerminationStrategy: PID 24683 died... 01:37:27.020759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24683): Terminated: ok {rc=0} 01:37:27.063491 --- ParallelTerminationStrategy: PID 24686 died... 01:37:27.081659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24686): Terminated: ok {rc=0} 01:37:27.165300 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 01:37:28.252463 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:28.263917 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 01:37:28.309575 tst ping_idle_ping.py: using LAC 37644 01:37:28.426594 tst ping_idle_ping.py: using RAC 159 01:37:28.541008 tst ping_idle_ping.py: using CellId 37644 01:37:28.654840 tst ping_idle_ping.py: using BVCI 37645 01:37:28.761550 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:28.772243 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:28.782848 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:28.793358 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:28.803737 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:28.814290 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:28.824910 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 01:37:28.835455 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 01:37:28.947997 tst ping_idle_ping.py:24: start network... 01:37:29.142794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:37:29.595790 run create_hlr_db(pid=24688): Launched 01:37:29.714680 bus /gobi_6: Setting Powered False 01:37:30.772596 run create_hlr_db(pid=24688): Terminated: ok {rc=0} 01:37:31.225679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24690): Launched 01:37:31.567911 run osmo-hlr_10.42.42.2(pid=24691): Launched 01:37:31.826648 run osmo-stp_10.42.42.5: Starting osmo-stp 01:37:32.419697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24693): Launched 01:37:32.712238 run osmo-stp_10.42.42.5(pid=24694): Launched 01:37:32.823691 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:37:33.341816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24696): Launched 01:37:33.453155 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:37:33.698950 run patchelf(pid=24697): Launched 01:37:33.860302 run osmo-stp_10.42.42.5(pid=24694): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24694)] 01:37:33.983135 run osmo-stp_10.42.42.5(pid=24694): stdout: | (launched: 2022-12-14_01:37:32.657875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:34.108026 run osmo-stp_10.42.42.5(pid=24694): stderr: | [0;m[38;5;43m20221214013732827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013732827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013732827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013732828 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013732828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013732828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013732828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:34.233723 run osmo-stp_10.42.42.5(pid=24694): stdout: | (launched: 2022-12-14_01:37:32.657875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:34.352284 run osmo-stp_10.42.42.5(pid=24694): stderr: | [0;m[38;5;43m20221214013732827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013732827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013732827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013732828 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013732828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013732828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013732828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:34.493102 run patchelf(pid=24697): Terminating (SIGINT) 01:37:34.655580 run patchelf(pid=24697): Terminated: ok {rc=0} 01:37:34.772801 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24694): Process ended prematurely: osmo-stp_10.42.42.5(pid=24694) [trial-2397↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24694)] [trial-2397↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 01:37:34.781694 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 01:37:34.807819 run osmo-hlr_10.42.42.2(pid=24691): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24691)] 01:37:34.855198 run osmo-hlr_10.42.42.2(pid=24691): stdout: | (launched: 2022-12-14_01:37:31.503597) 01:37:34.903519 run osmo-hlr_10.42.42.2(pid=24691): stderr: | [0;m[1;31m20221214013731725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013731725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013731725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013731726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013731726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013731726 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013731745 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013731753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013731754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013731754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:37:34.952124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24690): Terminating (SIGTERM) 01:37:34.990639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24693): Terminating (SIGTERM) 01:37:35.029263 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24696): Terminating (SIGTERM) 01:37:35.068329 --- ParallelTerminationStrategy: PID 24690 died... 01:37:35.087008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24690): Terminated: ok {rc=0} 01:37:35.130275 --- ParallelTerminationStrategy: PID 24693 died... 01:37:35.148556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24693): Terminated: ok {rc=0} 01:37:35.191835 --- ParallelTerminationStrategy: PID 24696 died... 01:37:35.210135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24696): Terminated: ok {rc=0} 01:37:35.292246 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 01:37:36.593504 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:37:36.599765 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:37:36.629238 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:37:36.669847 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:37:36.757258 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:37:36.786885 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:37:36.826361 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:37:37.427345 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:37:37.480447 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:37.491906 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:37:37.538149 tst cs_paging_gprs_active.py: using LAC 37645 01:37:37.662528 tst cs_paging_gprs_active.py: using RAC 160 01:37:37.785854 tst cs_paging_gprs_active.py: using CellId 37645 01:37:37.908907 tst cs_paging_gprs_active.py: using BVCI 37646 01:37:38.024507 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:38.036141 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:38.047368 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:38.058613 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:38.070114 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:38.081733 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:38.093414 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:38.104624 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:38.116287 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:37:38.234281 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:37:38.349515 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:37:38.549380 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:38.849920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24701): Launched 01:37:39.109744 run iperf3-srv_10.42.42.10(pid=24702): Launched 01:37:39.221455 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:37:39.421018 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:39.721402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24703): Launched 01:37:39.981917 run iperf3-srv_10.42.42.10(pid=24704): Launched 01:37:40.092820 tst cs_paging_gprs_active.py:38: start network... 01:37:40.292494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:37:40.750916 run create_hlr_db(pid=24705): Launched 01:37:40.873355 bus /gobi_6: Setting Powered False 01:37:41.932811 run create_hlr_db(pid=24705): Terminated: ok {rc=0} 01:37:42.369506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24707): Launched 01:37:42.690367 run osmo-hlr_10.42.42.2(pid=24708): Launched 01:37:42.812289 run osmo-stp_10.42.42.5: Starting osmo-stp 01:37:43.367067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24710): Launched 01:37:43.686306 run osmo-stp_10.42.42.5(pid=24711): Launched 01:37:43.807995 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:37:44.358683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24713): Launched 01:37:44.481413 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:37:44.751662 run patchelf(pid=24714): Launched 01:37:44.929131 run osmo-stp_10.42.42.5(pid=24711): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24711)] 01:37:45.064587 run osmo-stp_10.42.42.5(pid=24711): stdout: | (launched: 2022-12-14_01:37:43.627437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:45.201954 run osmo-stp_10.42.42.5(pid=24711): stderr: | [0;m[38;5;43m20221214013743813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013743813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013743814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013743814 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013743814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013743814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013743815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:45.339551 run osmo-stp_10.42.42.5(pid=24711): stdout: | (launched: 2022-12-14_01:37:43.627437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:45.470521 run osmo-stp_10.42.42.5(pid=24711): stderr: | [0;m[38;5;43m20221214013743813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013743813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013743814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013743814 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013743814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013743814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013743815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:45.625903 run patchelf(pid=24714): Terminating (SIGINT) 01:37:45.804663 run patchelf(pid=24714): Terminated: ok {rc=0} 01:37:45.958320 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24711): Process ended prematurely: osmo-stp_10.42.42.5(pid=24711) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24711)] [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:37:45.968393 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 01:37:45.996375 run osmo-hlr_10.42.42.2(pid=24708): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24708)] 01:37:46.044274 run osmo-hlr_10.42.42.2(pid=24708): stdout: | (launched: 2022-12-14_01:37:42.631150) 01:37:46.095332 run osmo-hlr_10.42.42.2(pid=24708): stderr: | [0;m[1;31m20221214013742823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013742823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013742823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013742823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013742823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013742823 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013742835 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013742843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013742844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013742844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:37:46.145824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24701): Terminating (SIGTERM) 01:37:46.186870 run iperf3-srv_10.42.42.10(pid=24702): Terminating (SIGTERM) 01:37:46.229702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24703): Terminating (SIGTERM) 01:37:46.270282 run iperf3-srv_10.42.42.10(pid=24704): Terminating (SIGTERM) 01:37:46.311373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24707): Terminating (SIGTERM) 01:37:46.352300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24710): Terminating (SIGTERM) 01:37:46.395836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24713): Terminating (SIGTERM) 01:37:46.439405 --- ParallelTerminationStrategy: PID 24701 died... 01:37:46.458639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24701): Terminated: ok {rc=0} 01:37:46.506567 --- ParallelTerminationStrategy: PID 24702 died... 01:37:46.525637 run iperf3-srv_10.42.42.10(pid=24702): Terminated {rc=256} 01:37:46.570208 --- ParallelTerminationStrategy: PID 24703 died... 01:37:46.589475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24703): Terminated: ok {rc=0} 01:37:46.633620 --- ParallelTerminationStrategy: PID 24704 died... 01:37:46.652428 run iperf3-srv_10.42.42.10(pid=24704): Terminated {rc=256} 01:37:46.698188 --- ParallelTerminationStrategy: PID 24707 died... 01:37:46.717734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24707): Terminated: ok {rc=0} 01:37:46.762098 --- ParallelTerminationStrategy: PID 24710 died... 01:37:46.781372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24710): Terminated: ok {rc=0} 01:37:46.826113 --- ParallelTerminationStrategy: PID 24713 died... 01:37:46.845502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24713): Terminated: ok {rc=0} 01:37:46.931894 bus /gobi_0: Setting Powered False 01:37:48.030273 bus /gobi_0: Setting Powered False 01:37:49.144832 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:37:50.292244 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:50.304420 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:37:50.352137 tst iperf3.py: using LAC 37646 01:37:50.478446 tst iperf3.py: using RAC 161 01:37:50.596225 tst iperf3.py: using CellId 37646 01:37:50.714872 tst iperf3.py: using BVCI 37647 01:37:50.822601 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:50.833720 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:50.844490 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:50.855339 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:50.866520 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:50.877928 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:50.889373 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:50.900430 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:50.911795 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:37:51.030694 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:37:51.245129 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:37:51.564700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24715): Launched 01:37:51.842609 run iperf3-srv_10.42.42.10(pid=24716): Launched 01:37:51.961874 tst iperf3.py:8: start network... 01:37:52.175365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:37:52.670046 run create_hlr_db(pid=24717): Launched 01:37:52.794606 bus /gobi_6: Setting Powered False 01:37:53.858183 run create_hlr_db(pid=24717): Terminated: ok {rc=0} 01:37:54.284865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24719): Launched 01:37:54.583988 run osmo-hlr_10.42.42.2(pid=24720): Launched 01:37:54.697855 run osmo-stp_10.42.42.5: Starting osmo-stp 01:37:55.210884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24722): Launched 01:37:55.507771 run osmo-stp_10.42.42.5(pid=24723): Launched 01:37:55.621454 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:37:56.133062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24725): Launched 01:37:56.247522 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:37:56.499100 run patchelf(pid=24726): Launched 01:37:56.664048 run osmo-stp_10.42.42.5(pid=24723): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24723)] 01:37:56.789561 run osmo-stp_10.42.42.5(pid=24723): stdout: | (launched: 2022-12-14_01:37:55.452758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:56.917402 run osmo-stp_10.42.42.5(pid=24723): stderr: | [0;m[38;5;43m20221214013755618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013755618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013755619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013755619 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013755620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013755620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013755620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:57.045140 run osmo-stp_10.42.42.5(pid=24723): stdout: | (launched: 2022-12-14_01:37:55.452758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:37:57.165783 run osmo-stp_10.42.42.5(pid=24723): stderr: | [0;m[38;5;43m20221214013755618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013755618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013755619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013755619 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013755620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013755620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013755620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:37:57.308939 run patchelf(pid=24726): Terminating (SIGINT) 01:37:57.474851 run patchelf(pid=24726): Terminated: ok {rc=0} 01:37:57.594968 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24723): Process ended prematurely: osmo-stp_10.42.42.5(pid=24723) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24723)] [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 01:37:57.604467 tst iperf3.py:8: Test FAILED (7.4 sec) 01:37:57.631336 run osmo-hlr_10.42.42.2(pid=24720): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24720)] 01:37:57.678232 run osmo-hlr_10.42.42.2(pid=24720): stdout: | (launched: 2022-12-14_01:37:54.528537) 01:37:57.726652 run osmo-hlr_10.42.42.2(pid=24720): stderr: | [0;m[1;31m20221214013754701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013754701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013754701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013754701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013754701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013754701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013754714 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013754722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013754722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013754722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:37:57.775399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24715): Terminating (SIGTERM) 01:37:57.814721 run iperf3-srv_10.42.42.10(pid=24716): Terminating (SIGTERM) 01:37:57.853664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24719): Terminating (SIGTERM) 01:37:57.892633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24722): Terminating (SIGTERM) 01:37:57.931832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24725): Terminating (SIGTERM) 01:37:57.971044 --- ParallelTerminationStrategy: PID 24715 died... 01:37:57.989899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24715): Terminated: ok {rc=0} 01:37:58.033226 --- ParallelTerminationStrategy: PID 24716 died... 01:37:58.051514 run iperf3-srv_10.42.42.10(pid=24716): Terminated {rc=256} 01:37:58.094619 --- ParallelTerminationStrategy: PID 24719 died... 01:37:58.112908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24719): Terminated: ok {rc=0} 01:37:58.155916 --- ParallelTerminationStrategy: PID 24722 died... 01:37:58.174223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24722): Terminated: ok {rc=0} 01:37:58.217445 --- ParallelTerminationStrategy: PID 24725 died... 01:37:58.235920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24725): Terminated: ok {rc=0} 01:37:58.320895 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:37:59.467893 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:37:59.479517 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:37:59.526218 tst iperf3m4.py: using LAC 37647 01:37:59.648011 tst iperf3m4.py: using RAC 162 01:37:59.763135 tst iperf3m4.py: using CellId 37647 01:37:59.877677 tst iperf3m4.py: using BVCI 37648 01:37:59.994997 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:00.006760 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:00.018221 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:00.029699 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:00.041941 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:00.054268 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:00.066668 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:00.079165 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:00.090897 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:38:00.214783 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:38:00.332456 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:38:00.450347 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:38:00.567493 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:38:00.765245 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:01.098054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24727): Launched 01:38:01.389268 run iperf3-srv_10.42.42.10(pid=24728): Launched 01:38:01.521617 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:38:01.745962 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:02.079458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24729): Launched 01:38:02.371269 run iperf3-srv_10.42.42.10(pid=24730): Launched 01:38:02.491193 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:38:02.705511 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:03.025268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24731): Launched 01:38:03.302665 run iperf3-srv_10.42.42.10(pid=24732): Launched 01:38:03.421876 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:38:03.635938 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:03.955789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24733): Launched 01:38:04.233004 run iperf3-srv_10.42.42.10(pid=24734): Launched 01:38:04.351767 tst iperf3m4.py:8: start network... 01:38:04.565513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:38:05.059245 run create_hlr_db(pid=24735): Launched 01:38:05.180401 bus /gobi_6: Setting Powered False 01:38:06.239912 run create_hlr_db(pid=24735): Terminated: ok {rc=0} 01:38:06.683590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24737): Launched 01:38:07.002850 run osmo-hlr_10.42.42.2(pid=24738): Launched 01:38:07.124392 run osmo-stp_10.42.42.5: Starting osmo-stp 01:38:07.678826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24740): Launched 01:38:07.996827 run osmo-stp_10.42.42.5(pid=24741): Launched 01:38:08.117047 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:38:08.665311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24743): Launched 01:38:08.787013 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:38:09.055775 run patchelf(pid=24744): Launched 01:38:09.232904 run osmo-stp_10.42.42.5(pid=24741): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24741)] 01:38:09.367990 run osmo-stp_10.42.42.5(pid=24741): stdout: | (launched: 2022-12-14_01:38:07.938040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:09.505157 run osmo-stp_10.42.42.5(pid=24741): stderr: | [0;m[38;5;43m20221214013808127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013808127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013808127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013808127 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013808128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013808128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013808128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:09.643068 run osmo-stp_10.42.42.5(pid=24741): stdout: | (launched: 2022-12-14_01:38:07.938040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:09.773217 run osmo-stp_10.42.42.5(pid=24741): stderr: | [0;m[38;5;43m20221214013808127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013808127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013808127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013808127 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013808128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013808128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013808128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:09.927489 run patchelf(pid=24744): Terminating (SIGINT) 01:38:10.105505 run patchelf(pid=24744): Terminated: ok {rc=0} 01:38:10.233912 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24741): Process ended prematurely: osmo-stp_10.42.42.5(pid=24741) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24741)] [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 01:38:10.244234 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:38:10.272611 run osmo-hlr_10.42.42.2(pid=24738): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24738)] 01:38:10.322883 run osmo-hlr_10.42.42.2(pid=24738): stdout: | (launched: 2022-12-14_01:38:06.944107) 01:38:10.374933 run osmo-hlr_10.42.42.2(pid=24738): stderr: | [0;m[1;31m20221214013807137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013807137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013807137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013807137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013807137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013807137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013807150 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013807158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013807158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013807158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:38:10.427498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24727): Terminating (SIGTERM) 01:38:10.469141 run iperf3-srv_10.42.42.10(pid=24728): Terminating (SIGTERM) 01:38:10.511351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24729): Terminating (SIGTERM) 01:38:10.553315 run iperf3-srv_10.42.42.10(pid=24730): Terminating (SIGTERM) 01:38:10.595547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24731): Terminating (SIGTERM) 01:38:10.637719 run iperf3-srv_10.42.42.10(pid=24732): Terminating (SIGTERM) 01:38:10.679448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24733): Terminating (SIGTERM) 01:38:10.721664 run iperf3-srv_10.42.42.10(pid=24734): Terminating (SIGTERM) 01:38:10.763450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24737): Terminating (SIGTERM) 01:38:10.805451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24740): Terminating (SIGTERM) 01:38:10.847284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24743): Terminating (SIGTERM) 01:38:10.889449 --- ParallelTerminationStrategy: PID 24727 died... 01:38:10.909915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24727): Terminated: ok {rc=0} 01:38:10.956373 --- ParallelTerminationStrategy: PID 24728 died... 01:38:10.976079 run iperf3-srv_10.42.42.10(pid=24728): Terminated {rc=256} 01:38:11.021799 --- ParallelTerminationStrategy: PID 24729 died... 01:38:11.041550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24729): Terminated: ok {rc=0} 01:38:11.087625 --- ParallelTerminationStrategy: PID 24730 died... 01:38:11.107434 run iperf3-srv_10.42.42.10(pid=24730): Terminated {rc=256} 01:38:11.153251 --- ParallelTerminationStrategy: PID 24731 died... 01:38:11.173130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24731): Terminated: ok {rc=0} 01:38:11.219325 --- ParallelTerminationStrategy: PID 24732 died... 01:38:11.239196 run iperf3-srv_10.42.42.10(pid=24732): Terminated {rc=256} 01:38:11.284822 --- ParallelTerminationStrategy: PID 24733 died... 01:38:11.305242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24733): Terminated: ok {rc=0} 01:38:11.351435 --- ParallelTerminationStrategy: PID 24734 died... 01:38:11.371430 run iperf3-srv_10.42.42.10(pid=24734): Terminated {rc=256} 01:38:11.416900 --- ParallelTerminationStrategy: PID 24737 died... 01:38:11.436748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24737): Terminated: ok {rc=0} 01:38:11.482323 --- ParallelTerminationStrategy: PID 24740 died... 01:38:11.502253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24740): Terminated: ok {rc=0} 01:38:11.547714 --- ParallelTerminationStrategy: PID 24743 died... 01:38:11.567640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24743): Terminated: ok {rc=0} 01:38:11.655238 bus /gobi_4: Setting Powered False 01:38:12.753933 bus /gobi_4: Setting Powered False 01:38:13.868912 bus /gobi_1: Setting Powered False 01:38:14.965530 bus /gobi_1: Setting Powered False 01:38:16.089298 bus /gobi_0: Setting Powered False 01:38:17.195608 bus /gobi_0: Setting Powered False 01:38:18.319862 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 01:38:19.421816 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:19.433974 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:38:19.482210 tst ping.py: using LAC 37648 01:38:19.606141 tst ping.py: using RAC 163 01:38:19.727914 tst ping.py: using CellId 37648 01:38:19.850460 tst ping.py: using BVCI 37649 01:38:19.963279 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:19.974758 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:19.986113 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:19.997486 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:20.008791 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:20.020274 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:20.032000 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:20.043540 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:38:20.161531 tst ping.py:19: start network... 01:38:20.371117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:38:20.854594 run create_hlr_db(pid=24745): Launched 01:38:20.972940 bus /gobi_6: Setting Powered False 01:38:22.035195 run create_hlr_db(pid=24745): Terminated: ok {rc=0} 01:38:22.453705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24747): Launched 01:38:22.748255 run osmo-hlr_10.42.42.2(pid=24748): Launched 01:38:22.857744 run osmo-stp_10.42.42.5: Starting osmo-stp 01:38:23.360724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24750): Launched 01:38:23.651932 run osmo-stp_10.42.42.5(pid=24751): Launched 01:38:23.762143 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:38:24.266104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24753): Launched 01:38:24.377873 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:38:24.625566 run patchelf(pid=24754): Launched 01:38:24.788174 run osmo-stp_10.42.42.5(pid=24751): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24751)] 01:38:24.912137 run osmo-stp_10.42.42.5(pid=24751): stdout: | (launched: 2022-12-14_01:38:23.597784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:25.037882 run osmo-stp_10.42.42.5(pid=24751): stderr: | [0;m[38;5;43m20221214013823763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013823763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013823764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013823764 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013823765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013823765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013823765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:25.163948 run osmo-stp_10.42.42.5(pid=24751): stdout: | (launched: 2022-12-14_01:38:23.597784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:25.283200 run osmo-stp_10.42.42.5(pid=24751): stderr: | [0;m[38;5;43m20221214013823763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013823763 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013823764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013823764 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013823765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013823765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013823765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:25.425433 run patchelf(pid=24754): Terminating (SIGINT) 01:38:25.588937 run patchelf(pid=24754): Terminated: ok {rc=0} 01:38:25.707277 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24751): Process ended prematurely: osmo-stp_10.42.42.5(pid=24751) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24751)] [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 01:38:25.716179 tst ping.py:22: Test FAILED (6.3 sec) 01:38:25.742623 run osmo-hlr_10.42.42.2(pid=24748): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24748)] 01:38:25.789572 run osmo-hlr_10.42.42.2(pid=24748): stdout: | (launched: 2022-12-14_01:38:22.693827) 01:38:25.838577 run osmo-hlr_10.42.42.2(pid=24748): stderr: | [0;m[1;31m20221214013822866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013822866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013822866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013822866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013822866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013822866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013822904 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013822914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013822914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013822914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:38:25.887965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24747): Terminating (SIGTERM) 01:38:25.927228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24750): Terminating (SIGTERM) 01:38:25.966262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24753): Terminating (SIGTERM) 01:38:26.005739 --- ParallelTerminationStrategy: PID 24747 died... 01:38:26.024673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24747): Terminated: ok {rc=0} 01:38:26.068239 --- ParallelTerminationStrategy: PID 24750 died... 01:38:26.086873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24750): Terminated: ok {rc=0} 01:38:26.130214 --- ParallelTerminationStrategy: PID 24753 died... 01:38:26.148779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24753): Terminated: ok {rc=0} 01:38:26.230930 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:38:27.316487 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:27.328743 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:38:27.377438 tst ping_idle_ping.py: using LAC 37649 01:38:27.501646 tst ping_idle_ping.py: using RAC 164 01:38:27.625913 tst ping_idle_ping.py: using CellId 37649 01:38:27.744456 tst ping_idle_ping.py: using BVCI 37650 01:38:27.850767 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:27.862105 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:27.873112 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:27.884187 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:27.895892 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:27.907300 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:27.918798 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:38:27.930000 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:38:28.048062 tst ping_idle_ping.py:24: start network... 01:38:28.258806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:38:28.747270 run create_hlr_db(pid=24755): Launched 01:38:28.867399 bus /gobi_6: Setting Powered False 01:38:29.929271 run create_hlr_db(pid=24755): Terminated: ok {rc=0} 01:38:30.368129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24757): Launched 01:38:30.682905 run osmo-hlr_10.42.42.2(pid=24758): Launched 01:38:30.801386 run osmo-stp_10.42.42.5: Starting osmo-stp 01:38:31.418867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24760): Launched 01:38:31.736661 run osmo-stp_10.42.42.5(pid=24761): Launched 01:38:32.005580 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:38:32.582307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24763): Launched 01:38:32.695601 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:38:32.942784 run patchelf(pid=24764): Launched 01:38:33.105728 run osmo-stp_10.42.42.5(pid=24761): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24761)] 01:38:33.229830 run osmo-stp_10.42.42.5(pid=24761): stdout: | (launched: 2022-12-14_01:38:31.677900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:33.355948 run osmo-stp_10.42.42.5(pid=24761): stderr: | [0;m[38;5;43m20221214013831908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013831909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013831909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013831909 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013831910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013831910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013831910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:33.481831 run osmo-stp_10.42.42.5(pid=24761): stdout: | (launched: 2022-12-14_01:38:31.677900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:33.601535 run osmo-stp_10.42.42.5(pid=24761): stderr: | [0;m[38;5;43m20221214013831908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013831909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013831909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013831909 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013831910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013831910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013831910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:33.742944 run patchelf(pid=24764): Terminating (SIGINT) 01:38:33.906761 run patchelf(pid=24764): Terminated: ok {rc=0} 01:38:34.024301 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24761): Process ended prematurely: osmo-stp_10.42.42.5(pid=24761) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24761)] [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 01:38:34.033347 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 01:38:34.059580 run osmo-hlr_10.42.42.2(pid=24758): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24758)] 01:38:34.106373 run osmo-hlr_10.42.42.2(pid=24758): stdout: | (launched: 2022-12-14_01:38:30.624536) 01:38:34.154986 run osmo-hlr_10.42.42.2(pid=24758): stderr: | [0;m[1;31m20221214013830816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013830816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013830816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013830816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013830816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013830816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013830857 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013830878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013830878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013830878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:38:34.204748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24757): Terminating (SIGTERM) 01:38:34.243835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24760): Terminating (SIGTERM) 01:38:34.283147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24763): Terminating (SIGTERM) 01:38:34.322553 --- ParallelTerminationStrategy: PID 24757 died... 01:38:34.341697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24757): Terminated: ok {rc=0} 01:38:34.385276 --- ParallelTerminationStrategy: PID 24760 died... 01:38:34.403878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24760): Terminated: ok {rc=0} 01:38:34.447073 --- ParallelTerminationStrategy: PID 24763 died... 01:38:34.465627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24763): Terminated: ok {rc=0} 01:38:34.551013 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:38:35.848210 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:38:35.854216 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:38:35.882604 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:38:35.921595 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:38:36.008069 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:38:36.036504 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:38:36.074501 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:38:36.670699 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:38:36.719280 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:36.730295 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:38:36.795586 tst cs_paging_gprs_active.py: using LAC 37650 01:38:36.913416 tst cs_paging_gprs_active.py: using RAC 165 01:38:37.029910 tst cs_paging_gprs_active.py: using CellId 37650 01:38:37.146242 tst cs_paging_gprs_active.py: using BVCI 37651 01:38:37.255217 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:37.266230 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:37.277017 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:37.287839 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:37.298918 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:37.309727 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:37.320528 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:37.331259 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:37.342154 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:38:37.462876 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:38:37.578363 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:38:37.778173 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:38.079342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24768): Launched 01:38:38.340566 run iperf3-srv_10.42.42.10(pid=24769): Launched 01:38:38.452007 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:38:38.651194 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:38.950957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24770): Launched 01:38:39.212141 run iperf3-srv_10.42.42.10(pid=24771): Launched 01:38:39.324316 tst cs_paging_gprs_active.py:38: start network... 01:38:39.523469 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:38:39.984559 run create_hlr_db(pid=24772): Launched 01:38:40.106499 bus /gobi_6: Setting Powered False 01:38:41.165792 run create_hlr_db(pid=24772): Terminated: ok {rc=0} 01:38:41.602597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24774): Launched 01:38:41.907016 run osmo-hlr_10.42.42.2(pid=24775): Launched 01:38:42.019559 run osmo-stp_10.42.42.5: Starting osmo-stp 01:38:42.551700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24777): Launched 01:38:42.850948 run osmo-stp_10.42.42.5(pid=24778): Launched 01:38:42.963137 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:38:43.477198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24780): Launched 01:38:43.591115 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:38:43.843501 run patchelf(pid=24781): Launched 01:38:44.009900 run osmo-stp_10.42.42.5(pid=24778): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24778)] 01:38:44.136301 run osmo-stp_10.42.42.5(pid=24778): stdout: | (launched: 2022-12-14_01:38:42.795140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:44.264073 run osmo-stp_10.42.42.5(pid=24778): stderr: | [0;m[38;5;43m20221214013842964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013842964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013842964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013842965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013842965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013842965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013842965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:44.391705 run osmo-stp_10.42.42.5(pid=24778): stdout: | (launched: 2022-12-14_01:38:42.795140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:44.515137 run osmo-stp_10.42.42.5(pid=24778): stderr: | [0;m[38;5;43m20221214013842964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013842964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013842964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013842965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013842965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013842965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013842965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:44.659219 run patchelf(pid=24781): Terminating (SIGINT) 01:38:44.827412 run patchelf(pid=24781): Terminated: ok {rc=0} 01:38:44.948158 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24778): Process ended prematurely: osmo-stp_10.42.42.5(pid=24778) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24778)] [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:38:44.957794 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 01:38:44.984549 run osmo-hlr_10.42.42.2(pid=24775): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24775)] 01:38:45.031896 run osmo-hlr_10.42.42.2(pid=24775): stdout: | (launched: 2022-12-14_01:38:41.850769) 01:38:45.080446 run osmo-hlr_10.42.42.2(pid=24775): stderr: | [0;m[1;31m20221214013842021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013842022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013842022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013842022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013842022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013842022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013842034 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013842042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013842042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013842042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:38:45.129653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24768): Terminating (SIGTERM) 01:38:45.168652 run iperf3-srv_10.42.42.10(pid=24769): Terminating (SIGTERM) 01:38:45.207626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24770): Terminating (SIGTERM) 01:38:45.246612 run iperf3-srv_10.42.42.10(pid=24771): Terminating (SIGTERM) 01:38:45.285386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24774): Terminating (SIGTERM) 01:38:45.324398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24777): Terminating (SIGTERM) 01:38:45.363260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24780): Terminating (SIGTERM) 01:38:45.402447 --- ParallelTerminationStrategy: PID 24768 died... 01:38:45.420780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24768): Terminated: ok {rc=0} 01:38:45.463747 --- ParallelTerminationStrategy: PID 24769 died... 01:38:45.481941 run iperf3-srv_10.42.42.10(pid=24769): Terminated {rc=256} 01:38:45.524821 --- ParallelTerminationStrategy: PID 24770 died... 01:38:45.543157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24770): Terminated: ok {rc=0} 01:38:45.585665 --- ParallelTerminationStrategy: PID 24771 died... 01:38:45.603964 run iperf3-srv_10.42.42.10(pid=24771): Terminated {rc=256} 01:38:45.646672 --- ParallelTerminationStrategy: PID 24774 died... 01:38:45.664843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24774): Terminated: ok {rc=0} 01:38:45.707907 --- ParallelTerminationStrategy: PID 24777 died... 01:38:45.726324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24777): Terminated: ok {rc=0} 01:38:45.769189 --- ParallelTerminationStrategy: PID 24780 died... 01:38:45.787469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24780): Terminated: ok {rc=0} 01:38:45.877210 bus /gobi_0: Setting Powered False 01:38:46.982209 bus /gobi_0: Setting Powered False 01:38:48.106531 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:38:49.247487 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:49.259301 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:38:49.326825 tst iperf3.py: using LAC 37651 01:38:49.443865 tst iperf3.py: using RAC 166 01:38:49.563328 tst iperf3.py: using CellId 37651 01:38:49.677694 tst iperf3.py: using BVCI 37652 01:38:49.784412 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:49.795623 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:49.806681 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:49.817699 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:49.828530 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:49.839347 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:49.850283 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:49.860866 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:49.871830 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:38:49.991652 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:38:50.206372 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:38:50.526991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24782): Launched 01:38:50.807238 run iperf3-srv_10.42.42.10(pid=24783): Launched 01:38:50.926693 tst iperf3.py:8: start network... 01:38:51.141027 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:38:51.633087 run create_hlr_db(pid=24784): Launched 01:38:51.755877 bus /gobi_6: Setting Powered False 01:38:52.818281 run create_hlr_db(pid=24784): Terminated: ok {rc=0} 01:38:53.244378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24786): Launched 01:38:53.542477 run osmo-hlr_10.42.42.2(pid=24787): Launched 01:38:53.655856 run osmo-stp_10.42.42.5: Starting osmo-stp 01:38:54.187891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24789): Launched 01:38:54.486311 run osmo-stp_10.42.42.5(pid=24790): Launched 01:38:54.598904 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:38:55.114220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24792): Launched 01:38:55.228341 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:38:55.480324 run patchelf(pid=24793): Launched 01:38:55.646698 run osmo-stp_10.42.42.5(pid=24790): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24790)] 01:38:55.773491 run osmo-stp_10.42.42.5(pid=24790): stdout: | (launched: 2022-12-14_01:38:54.430572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:55.902300 run osmo-stp_10.42.42.5(pid=24790): stderr: | [0;m[38;5;43m20221214013854598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013854598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013854598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013854598 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013854599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013854599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013854599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:56.031167 run osmo-stp_10.42.42.5(pid=24790): stdout: | (launched: 2022-12-14_01:38:54.430572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:38:56.152676 run osmo-stp_10.42.42.5(pid=24790): stderr: | [0;m[38;5;43m20221214013854598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013854598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013854598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013854598 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013854599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013854599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013854599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:38:56.296800 run patchelf(pid=24793): Terminating (SIGINT) 01:38:56.464057 run patchelf(pid=24793): Terminated: ok {rc=0} 01:38:56.584824 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24790): Process ended prematurely: osmo-stp_10.42.42.5(pid=24790) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24790)] [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 01:38:56.594702 tst iperf3.py:8: Test FAILED (7.4 sec) 01:38:56.621733 run osmo-hlr_10.42.42.2(pid=24787): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24787)] 01:38:56.668552 run osmo-hlr_10.42.42.2(pid=24787): stdout: | (launched: 2022-12-14_01:38:53.486757) 01:38:56.717225 run osmo-hlr_10.42.42.2(pid=24787): stderr: | [0;m[1;31m20221214013853659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013853659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013853659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013853659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013853659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013853660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013853673 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013853682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013853682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013853682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:38:56.766429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24782): Terminating (SIGTERM) 01:38:56.806956 run iperf3-srv_10.42.42.10(pid=24783): Terminating (SIGTERM) 01:38:56.846584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24786): Terminating (SIGTERM) 01:38:56.885778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24789): Terminating (SIGTERM) 01:38:56.924922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24792): Terminating (SIGTERM) 01:38:56.964235 --- ParallelTerminationStrategy: PID 24782 died... 01:38:56.983090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24782): Terminated: ok {rc=0} 01:38:57.026577 --- ParallelTerminationStrategy: PID 24783 died... 01:38:57.045247 run iperf3-srv_10.42.42.10(pid=24783): Terminated {rc=256} 01:38:57.088542 --- ParallelTerminationStrategy: PID 24786 died... 01:38:57.107387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24786): Terminated: ok {rc=0} 01:38:57.150730 --- ParallelTerminationStrategy: PID 24789 died... 01:38:57.169391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24789): Terminated: ok {rc=0} 01:38:57.212727 --- ParallelTerminationStrategy: PID 24792 died... 01:38:57.231386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24792): Terminated: ok {rc=0} 01:38:57.315958 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:38:58.460873 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:58.472708 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:38:58.539791 tst iperf3m4.py: using LAC 37652 01:38:58.655571 tst iperf3m4.py: using RAC 167 01:38:58.771805 tst iperf3m4.py: using CellId 37652 01:38:58.889318 tst iperf3m4.py: using BVCI 37653 01:38:58.996127 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:59.007320 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:59.018521 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:59.029658 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:59.040786 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:59.051934 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:59.063186 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:59.074307 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:38:59.085733 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:38:59.200351 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:38:59.320699 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:38:59.439920 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:38:59.560517 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:38:59.774921 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:00.097402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24794): Launched 01:39:00.377169 run iperf3-srv_10.42.42.10(pid=24795): Launched 01:39:00.497438 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:39:00.712161 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:01.057846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24796): Launched 01:39:01.385775 run iperf3-srv_10.42.42.10(pid=24804): Launched 01:39:01.566321 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:39:01.799255 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:02.154317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24846): Launched 01:39:02.496593 run iperf3-srv_10.42.42.10(pid=24859): Launched 01:39:02.638951 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:39:02.869018 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:03.219424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24891): Launched 01:39:03.552075 run iperf3-srv_10.42.42.10(pid=24928): Launched 01:39:03.716082 tst iperf3m4.py:8: start network... 01:39:03.983400 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:39:04.562058 run create_hlr_db(pid=25066): Launched 01:39:04.741449 bus /gobi_6: Setting Powered False 01:39:05.802619 run create_hlr_db(pid=25066): Terminated: ok {rc=0} 01:39:06.237994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25074): Launched 01:39:06.565758 run osmo-hlr_10.42.42.2(pid=25076): Launched 01:39:06.800690 run osmo-stp_10.42.42.5: Starting osmo-stp 01:39:07.443946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25079): Launched 01:39:07.778382 run osmo-stp_10.42.42.5(pid=25080): Launched 01:39:08.020136 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:39:08.650642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25082): Launched 01:39:08.782092 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:39:09.040694 run patchelf(pid=25083): Launched 01:39:09.225794 run osmo-stp_10.42.42.5(pid=25080): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25080)] 01:39:09.355257 run osmo-stp_10.42.42.5(pid=25080): stdout: | (launched: 2022-12-14_01:39:07.719465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:09.489208 run osmo-stp_10.42.42.5(pid=25080): stderr: | [0;m[38;5;43m20221214013908003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013908003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013908003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013908003 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013908004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013908004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013908004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:09.621554 run osmo-stp_10.42.42.5(pid=25080): stdout: | (launched: 2022-12-14_01:39:07.719465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:09.748435 run osmo-stp_10.42.42.5(pid=25080): stderr: | [0;m[38;5;43m20221214013908003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013908003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013908003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013908003 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013908004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013908004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013908004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:09.896790 run patchelf(pid=25083): Terminating (SIGINT) 01:39:10.071077 run patchelf(pid=25083): Terminated: ok {rc=0} 01:39:10.195438 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25080): Process ended prematurely: osmo-stp_10.42.42.5(pid=25080) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25080)] [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:39:10.205243 tst iperf3m4.py:8: Test FAILED (11.8 sec) 01:39:10.233632 run osmo-hlr_10.42.42.2(pid=25076): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25076)] 01:39:10.281494 run osmo-hlr_10.42.42.2(pid=25076): stdout: | (launched: 2022-12-14_01:39:06.504760) 01:39:10.332689 run osmo-hlr_10.42.42.2(pid=25076): stderr: | [0;m[1;31m20221214013906798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013906798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013906798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013906798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013906798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013906798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013906822 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013906850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013906850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013906850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:39:10.382987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24794): Terminating (SIGTERM) 01:39:10.423319 run iperf3-srv_10.42.42.10(pid=24795): Terminating (SIGTERM) 01:39:10.467791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24796): Terminating (SIGTERM) 01:39:10.509967 run iperf3-srv_10.42.42.10(pid=24804): Terminating (SIGTERM) 01:39:10.553347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24846): Terminating (SIGTERM) 01:39:10.594987 run iperf3-srv_10.42.42.10(pid=24859): Terminating (SIGTERM) 01:39:10.638554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24891): Terminating (SIGTERM) 01:39:10.680250 run iperf3-srv_10.42.42.10(pid=24928): Terminating (SIGTERM) 01:39:10.725631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25074): Terminating (SIGTERM) 01:39:10.767586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25079): Terminating (SIGTERM) 01:39:10.809323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25082): Terminating (SIGTERM) 01:39:10.850191 --- ParallelTerminationStrategy: PID 24794 died... 01:39:10.869408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24794): Terminated: ok {rc=0} 01:39:10.916885 --- ParallelTerminationStrategy: PID 24795 died... 01:39:10.936717 run iperf3-srv_10.42.42.10(pid=24795): Terminated {rc=256} 01:39:10.981677 --- ParallelTerminationStrategy: PID 24796 died... 01:39:11.000864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24796): Terminated: ok {rc=0} 01:39:11.045125 --- ParallelTerminationStrategy: PID 24804 died... 01:39:11.064198 run iperf3-srv_10.42.42.10(pid=24804): Terminated {rc=256} 01:39:11.109431 --- ParallelTerminationStrategy: PID 24846 died... 01:39:11.128730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24846): Terminated: ok {rc=0} 01:39:11.173112 --- ParallelTerminationStrategy: PID 24859 died... 01:39:11.193628 run iperf3-srv_10.42.42.10(pid=24859): Terminated {rc=256} 01:39:11.239747 --- ParallelTerminationStrategy: PID 24891 died... 01:39:11.259923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24891): Terminated: ok {rc=0} 01:39:11.306472 --- ParallelTerminationStrategy: PID 24928 died... 01:39:11.326735 run iperf3-srv_10.42.42.10(pid=24928): Terminated {rc=256} 01:39:11.372246 --- ParallelTerminationStrategy: PID 25074 died... 01:39:11.393058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25074): Terminated: ok {rc=0} 01:39:11.439040 --- ParallelTerminationStrategy: PID 25079 died... 01:39:11.460346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25079): Terminated: ok {rc=0} 01:39:11.508091 --- ParallelTerminationStrategy: PID 25082 died... 01:39:11.529217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25082): Terminated: ok {rc=0} 01:39:11.617608 bus /gobi_4: Setting Powered False 01:39:12.717372 bus /gobi_4: Setting Powered False 01:39:13.833770 bus /gobi_1: Setting Powered False 01:39:14.934220 bus /gobi_1: Setting Powered False 01:39:16.070582 bus /gobi_0: Setting Powered False 01:39:17.204697 bus /gobi_0: Setting Powered False 01:39:18.341698 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:39:19.451294 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:19.465893 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:39:19.538719 tst ping.py: using LAC 37653 01:39:19.667056 tst ping.py: using RAC 168 01:39:19.794503 tst ping.py: using CellId 37653 01:39:19.921738 tst ping.py: using BVCI 37654 01:39:20.040276 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:20.053001 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:20.065569 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:20.078056 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:20.092408 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:20.106191 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:20.119752 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:20.133345 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:39:20.258862 tst ping.py:19: start network... 01:39:20.481202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:39:20.989340 run create_hlr_db(pid=25084): Launched 01:39:21.153334 bus /gobi_6: Setting Powered False 01:39:22.220515 run create_hlr_db(pid=25084): Terminated: ok {rc=0} 01:39:22.679431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25086): Launched 01:39:23.017828 run osmo-hlr_10.42.42.2(pid=25087): Launched 01:39:23.255872 run osmo-stp_10.42.42.5: Starting osmo-stp 01:39:23.930459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25089): Launched 01:39:24.268566 run osmo-stp_10.42.42.5(pid=25090): Launched 01:39:24.515646 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:39:25.154590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25092): Launched 01:39:25.291571 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:39:25.572541 run patchelf(pid=25094): Launched 01:39:25.751679 run osmo-stp_10.42.42.5(pid=25090): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25090)] 01:39:25.885630 run osmo-stp_10.42.42.5(pid=25090): stdout: | (launched: 2022-12-14_01:39:24.207454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:26.021227 run osmo-stp_10.42.42.5(pid=25090): stderr: | [0;m[38;5;43m20221214013924502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013924502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013924503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013924503 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013924504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013924504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013924504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:26.157103 run osmo-stp_10.42.42.5(pid=25090): stdout: | (launched: 2022-12-14_01:39:24.207454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:26.286348 run osmo-stp_10.42.42.5(pid=25090): stderr: | [0;m[38;5;43m20221214013924502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013924502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013924503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013924503 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013924504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013924504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013924504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:26.439833 run patchelf(pid=25094): Terminating (SIGINT) 01:39:26.615894 run patchelf(pid=25094): Terminated: ok {rc=0} 01:39:26.743866 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25090): Process ended prematurely: osmo-stp_10.42.42.5(pid=25090) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25090)] [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 01:39:26.753660 tst ping.py:22: Test FAILED (7.3 sec) 01:39:26.781657 run osmo-hlr_10.42.42.2(pid=25087): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25087)] 01:39:26.831984 run osmo-hlr_10.42.42.2(pid=25087): stdout: | (launched: 2022-12-14_01:39:22.958761) 01:39:26.883550 run osmo-hlr_10.42.42.2(pid=25087): stderr: | [0;m[1;31m20221214013923263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013923263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013923263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013923263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013923263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013923263 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013923281 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013923294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013923294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013923294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:39:26.935752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25086): Terminating (SIGTERM) 01:39:26.977078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25089): Terminating (SIGTERM) 01:39:27.018492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25092): Terminating (SIGTERM) 01:39:27.060497 --- ParallelTerminationStrategy: PID 25086 died... 01:39:27.080851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25086): Terminated: ok {rc=0} 01:39:27.127163 --- ParallelTerminationStrategy: PID 25089 died... 01:39:27.146903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25089): Terminated: ok {rc=0} 01:39:27.192652 --- ParallelTerminationStrategy: PID 25092 died... 01:39:27.212459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25092): Terminated: ok {rc=0} 01:39:27.300158 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:39:28.388003 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:28.399809 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:39:28.465689 tst ping_idle_ping.py: using LAC 37654 01:39:28.583563 tst ping_idle_ping.py: using RAC 169 01:39:28.708380 tst ping_idle_ping.py: using CellId 37654 01:39:28.832859 tst ping_idle_ping.py: using BVCI 37655 01:39:28.947623 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:28.959406 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:28.971003 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:28.982671 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:28.994840 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:29.007011 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:29.019001 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:39:29.030846 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:39:29.145913 tst ping_idle_ping.py:24: start network... 01:39:29.343061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:39:29.802853 run create_hlr_db(pid=25095): Launched 01:39:29.925649 bus /gobi_6: Setting Powered False 01:39:31.000662 run create_hlr_db(pid=25095): Terminated: ok {rc=0} 01:39:31.503064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25097): Launched 01:39:31.817049 run osmo-hlr_10.42.42.2(pid=25098): Launched 01:39:32.051960 run osmo-stp_10.42.42.5: Starting osmo-stp 01:39:32.635992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25100): Launched 01:39:32.932310 run osmo-stp_10.42.42.5(pid=25101): Launched 01:39:33.043835 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:39:33.554037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25103): Launched 01:39:33.668810 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:39:33.918958 run patchelf(pid=25104): Launched 01:39:34.082802 run osmo-stp_10.42.42.5(pid=25101): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25101)] 01:39:34.207372 run osmo-stp_10.42.42.5(pid=25101): stdout: | (launched: 2022-12-14_01:39:32.876635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:34.333977 run osmo-stp_10.42.42.5(pid=25101): stderr: | [0;m[38;5;43m20221214013933044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013933044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013933044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013933045 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013933045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013933045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013933045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:34.460272 run osmo-stp_10.42.42.5(pid=25101): stdout: | (launched: 2022-12-14_01:39:32.876635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:34.580292 run osmo-stp_10.42.42.5(pid=25101): stderr: | [0;m[38;5;43m20221214013933044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013933044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013933044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013933045 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013933045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013933045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013933045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:34.722444 run patchelf(pid=25104): Terminating (SIGINT) 01:39:34.887157 run patchelf(pid=25104): Terminated: ok {rc=0} 01:39:35.006203 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25101): Process ended prematurely: osmo-stp_10.42.42.5(pid=25101) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25101)] [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:39:35.015117 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 01:39:35.041526 run osmo-hlr_10.42.42.2(pid=25098): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25098)] 01:39:35.088446 run osmo-hlr_10.42.42.2(pid=25098): stdout: | (launched: 2022-12-14_01:39:31.760715) 01:39:35.137252 run osmo-hlr_10.42.42.2(pid=25098): stderr: | [0;m[1;31m20221214013931945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013931945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013931945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013931946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013931946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013931946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013931964 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013931984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013931984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013931984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:39:35.186282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25097): Terminating (SIGTERM) 01:39:35.225219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25100): Terminating (SIGTERM) 01:39:35.264012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25103): Terminating (SIGTERM) 01:39:35.303078 --- ParallelTerminationStrategy: PID 25097 died... 01:39:35.322028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25097): Terminated: ok {rc=0} 01:39:35.365293 --- ParallelTerminationStrategy: PID 25100 died... 01:39:35.383621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25100): Terminated: ok {rc=0} 01:39:35.426580 --- ParallelTerminationStrategy: PID 25103 died... 01:39:35.445032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25103): Terminated: ok {rc=0} 01:39:35.530009 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 01:39:36.833579 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:39:36.839683 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 01:39:36.868447 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 01:39:36.911544 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 01:39:37.002191 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 01:39:37.032641 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 01:39:37.072395 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 01:39:37.669665 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 01:39:37.722311 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:37.734144 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:39:37.803713 tst cs_paging_gprs_active.py: using LAC 37655 01:39:37.930233 tst cs_paging_gprs_active.py: using RAC 170 01:39:38.053934 tst cs_paging_gprs_active.py: using CellId 37655 01:39:38.171614 tst cs_paging_gprs_active.py: using BVCI 37656 01:39:38.280232 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:38.291417 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:38.302554 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:38.313698 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:38.324915 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:38.336269 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:38.347704 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:38.358904 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:38.370411 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:39:38.491049 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:39:38.609113 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:39:38.811600 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:39.114883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25108): Launched 01:39:39.378772 run iperf3-srv_10.42.42.10(pid=25109): Launched 01:39:39.493891 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:39:39.695468 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:39.999200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25110): Launched 01:39:40.262461 run iperf3-srv_10.42.42.10(pid=25111): Launched 01:39:40.375456 tst cs_paging_gprs_active.py:38: start network... 01:39:40.577199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:39:41.043922 run create_hlr_db(pid=25112): Launched 01:39:41.168106 bus /gobi_6: Setting Powered False 01:39:42.227570 run create_hlr_db(pid=25112): Terminated: ok {rc=0} 01:39:42.648632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25114): Launched 01:39:42.951107 run osmo-hlr_10.42.42.2(pid=25115): Launched 01:39:43.065920 run osmo-stp_10.42.42.5: Starting osmo-stp 01:39:43.583944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25117): Launched 01:39:43.885417 run osmo-stp_10.42.42.5(pid=25118): Launched 01:39:44.000519 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:39:44.522203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25120): Launched 01:39:44.637863 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:39:44.901365 run patchelf(pid=25121): Launched 01:39:45.069803 run osmo-stp_10.42.42.5(pid=25118): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25118)] 01:39:45.198713 run osmo-stp_10.42.42.5(pid=25118): stdout: | (launched: 2022-12-14_01:39:43.829073) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:45.328164 run osmo-stp_10.42.42.5(pid=25118): stderr: | [0;m[38;5;43m20221214013943999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013943999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013943999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013943999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013944000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013944000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013944000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:45.457262 run osmo-stp_10.42.42.5(pid=25118): stdout: | (launched: 2022-12-14_01:39:43.829073) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:45.580557 run osmo-stp_10.42.42.5(pid=25118): stderr: | [0;m[38;5;43m20221214013943999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013943999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013943999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013943999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013944000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013944000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013944000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:45.726864 run patchelf(pid=25121): Terminating (SIGINT) 01:39:45.897113 run patchelf(pid=25121): Terminated: ok {rc=0} 01:39:46.021378 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25118): Process ended prematurely: osmo-stp_10.42.42.5(pid=25118) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25118)] [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 01:39:46.032078 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 01:39:46.060462 run osmo-hlr_10.42.42.2(pid=25115): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25115)] 01:39:46.109327 run osmo-hlr_10.42.42.2(pid=25115): stdout: | (launched: 2022-12-14_01:39:42.894835) 01:39:46.159372 run osmo-hlr_10.42.42.2(pid=25115): stderr: | [0;m[1;31m20221214013943070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013943071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013943071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013943071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013943071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013943071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013943083 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013943091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013943092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013943092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:39:46.209442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25108): Terminating (SIGTERM) 01:39:46.249370 run iperf3-srv_10.42.42.10(pid=25109): Terminating (SIGTERM) 01:39:46.289869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25110): Terminating (SIGTERM) 01:39:46.330692 run iperf3-srv_10.42.42.10(pid=25111): Terminating (SIGTERM) 01:39:46.373729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25114): Terminating (SIGTERM) 01:39:46.415146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25117): Terminating (SIGTERM) 01:39:46.457615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25120): Terminating (SIGTERM) 01:39:46.500399 --- ParallelTerminationStrategy: PID 25108 died... 01:39:46.520217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25108): Terminated: ok {rc=0} 01:39:46.564729 --- ParallelTerminationStrategy: PID 25109 died... 01:39:46.583813 run iperf3-srv_10.42.42.10(pid=25109): Terminated {rc=256} 01:39:46.628041 --- ParallelTerminationStrategy: PID 25110 died... 01:39:46.647047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25110): Terminated: ok {rc=0} 01:39:46.691779 --- ParallelTerminationStrategy: PID 25111 died... 01:39:46.711358 run iperf3-srv_10.42.42.10(pid=25111): Terminated {rc=256} 01:39:46.755634 --- ParallelTerminationStrategy: PID 25114 died... 01:39:46.775351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25114): Terminated: ok {rc=0} 01:39:46.819807 --- ParallelTerminationStrategy: PID 25117 died... 01:39:46.839412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25117): Terminated: ok {rc=0} 01:39:46.883476 --- ParallelTerminationStrategy: PID 25120 died... 01:39:46.902695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25120): Terminated: ok {rc=0} 01:39:46.988704 bus /gobi_0: Setting Powered False 01:39:48.087459 bus /gobi_0: Setting Powered False 01:39:49.202857 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 01:39:50.352228 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:50.364642 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:39:50.434565 tst iperf3.py: using LAC 37656 01:39:50.560474 tst iperf3.py: using RAC 171 01:39:50.686121 tst iperf3.py: using CellId 37656 01:39:50.811702 tst iperf3.py: using BVCI 37657 01:39:50.930442 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:50.942109 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:50.953645 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:50.965656 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:50.977550 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:50.989402 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:51.001402 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:51.013223 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:51.025354 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:39:51.143838 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:39:51.345715 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:39:51.647613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25122): Launched 01:39:51.911000 run iperf3-srv_10.42.42.10(pid=25123): Launched 01:39:52.025088 tst iperf3.py:8: start network... 01:39:52.225295 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:39:52.690540 run create_hlr_db(pid=25124): Launched 01:39:52.814108 bus /gobi_6: Setting Powered False 01:39:53.873644 run create_hlr_db(pid=25124): Terminated: ok {rc=0} 01:39:54.293589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25126): Launched 01:39:54.596622 run osmo-hlr_10.42.42.2(pid=25127): Launched 01:39:54.711988 run osmo-stp_10.42.42.5: Starting osmo-stp 01:39:55.231791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25129): Launched 01:39:55.536063 run osmo-stp_10.42.42.5(pid=25130): Launched 01:39:55.650405 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:39:56.171393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25132): Launched 01:39:56.288198 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:39:56.542808 run patchelf(pid=25133): Launched 01:39:56.709998 run osmo-stp_10.42.42.5(pid=25130): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25130)] 01:39:56.836935 run osmo-stp_10.42.42.5(pid=25130): stdout: | (launched: 2022-12-14_01:39:55.480060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:56.966225 run osmo-stp_10.42.42.5(pid=25130): stderr: | [0;m[38;5;43m20221214013955650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013955650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013955650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013955651 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013955651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013955651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013955651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:57.095644 run osmo-stp_10.42.42.5(pid=25130): stdout: | (launched: 2022-12-14_01:39:55.480060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:39:57.218656 run osmo-stp_10.42.42.5(pid=25130): stderr: | [0;m[38;5;43m20221214013955650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214013955650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214013955650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214013955651 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214013955651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214013955651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214013955651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:39:57.364529 run patchelf(pid=25133): Terminating (SIGINT) 01:39:57.533083 run patchelf(pid=25133): Terminated: ok {rc=0} 01:39:57.654640 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25130): Process ended prematurely: osmo-stp_10.42.42.5(pid=25130) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25130)] [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 01:39:57.664119 tst iperf3.py:8: Test FAILED (7.4 sec) 01:39:57.691006 run osmo-hlr_10.42.42.2(pid=25127): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25127)] 01:39:57.737603 run osmo-hlr_10.42.42.2(pid=25127): stdout: | (launched: 2022-12-14_01:39:54.540302) 01:39:57.786213 run osmo-hlr_10.42.42.2(pid=25127): stderr: | [0;m[1;31m20221214013954716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214013954716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214013954716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214013954716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214013954716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214013954716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214013954731 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214013954741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214013954741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214013954741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:39:57.835126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25122): Terminating (SIGTERM) 01:39:57.874075 run iperf3-srv_10.42.42.10(pid=25123): Terminating (SIGTERM) 01:39:57.913325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25126): Terminating (SIGTERM) 01:39:57.952343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25129): Terminating (SIGTERM) 01:39:57.991483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25132): Terminating (SIGTERM) 01:39:58.030723 --- ParallelTerminationStrategy: PID 25122 died... 01:39:58.049754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25122): Terminated: ok {rc=0} 01:39:58.093101 --- ParallelTerminationStrategy: PID 25123 died... 01:39:58.111965 run iperf3-srv_10.42.42.10(pid=25123): Terminated {rc=256} 01:39:58.155160 --- ParallelTerminationStrategy: PID 25126 died... 01:39:58.173467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25126): Terminated: ok {rc=0} 01:39:58.216601 --- ParallelTerminationStrategy: PID 25129 died... 01:39:58.235073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25129): Terminated: ok {rc=0} 01:39:58.278519 --- ParallelTerminationStrategy: PID 25132 died... 01:39:58.297251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25132): Terminated: ok {rc=0} 01:39:58.380772 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 01:39:59.531714 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:39:59.544108 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:39:59.614475 tst iperf3m4.py: using LAC 37657 01:39:59.742330 tst iperf3m4.py: using RAC 172 01:39:59.870242 tst iperf3m4.py: using CellId 37657 01:39:59.997760 tst iperf3m4.py: using BVCI 37658 01:40:00.116412 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:00.128144 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:00.139535 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:00.151017 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:00.162794 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:00.174551 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:00.186468 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:00.198146 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:00.210281 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:40:00.331221 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:40:00.450823 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:40:00.567978 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:40:00.686252 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:40:00.899711 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:40:01.211003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25134): Launched 01:40:01.515873 run iperf3-srv_10.42.42.10(pid=25135): Launched 01:40:01.658670 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:40:01.905113 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:40:02.244292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25139): Launched 01:40:02.536186 run iperf3-srv_10.42.42.10(pid=25140): Launched 01:40:02.658115 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:40:02.876316 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:40:03.201685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25141): Launched 01:40:03.486779 run iperf3-srv_10.42.42.10(pid=25142): Launched 01:40:03.609819 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:40:03.827644 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:40:04.152906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25143): Launched 01:40:04.435889 run iperf3-srv_10.42.42.10(pid=25144): Launched 01:40:04.558582 tst iperf3m4.py:8: start network... 01:40:04.776622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:40:05.278095 run create_hlr_db(pid=25145): Launched 01:40:05.400606 bus /gobi_6: Setting Powered False 01:40:06.464432 run create_hlr_db(pid=25145): Terminated: ok {rc=0} 01:40:06.896226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25147): Launched 01:40:07.198995 run osmo-hlr_10.42.42.2(pid=25148): Launched 01:40:07.313999 run osmo-stp_10.42.42.5: Starting osmo-stp 01:40:07.837497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25150): Launched 01:40:08.140577 run osmo-stp_10.42.42.5(pid=25151): Launched 01:40:08.255778 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:40:08.774589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25153): Launched 01:40:08.891995 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:40:09.147404 run patchelf(pid=25154): Launched 01:40:09.316061 run osmo-stp_10.42.42.5(pid=25151): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25151)] 01:40:09.444712 run osmo-stp_10.42.42.5(pid=25151): stdout: | (launched: 2022-12-14_01:40:08.084118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:09.573990 run osmo-stp_10.42.42.5(pid=25151): stderr: | [0;m[38;5;43m20221214014008252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014008253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014008253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014008253 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014008254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014008254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014008254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:09.703324 run osmo-stp_10.42.42.5(pid=25151): stdout: | (launched: 2022-12-14_01:40:08.084118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:09.825675 run osmo-stp_10.42.42.5(pid=25151): stderr: | [0;m[38;5;43m20221214014008252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014008253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014008253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014008253 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014008254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014008254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014008254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:09.971176 run patchelf(pid=25154): Terminating (SIGINT) 01:40:10.139457 run patchelf(pid=25154): Terminated: ok {rc=0} 01:40:10.261492 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25151): Process ended prematurely: osmo-stp_10.42.42.5(pid=25151) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25151)] [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 01:40:10.271061 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:40:10.298517 run osmo-hlr_10.42.42.2(pid=25148): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25148)] 01:40:10.345846 run osmo-hlr_10.42.42.2(pid=25148): stdout: | (launched: 2022-12-14_01:40:07.142979) 01:40:10.394772 run osmo-hlr_10.42.42.2(pid=25148): stderr: | [0;m[1;31m20221214014007317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014007317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014007318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014007318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014007318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014007318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014007331 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014007341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014007342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014007342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:40:10.444225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25134): Terminating (SIGTERM) 01:40:10.484270 run iperf3-srv_10.42.42.10(pid=25135): Terminating (SIGTERM) 01:40:10.523713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25139): Terminating (SIGTERM) 01:40:10.563265 run iperf3-srv_10.42.42.10(pid=25140): Terminating (SIGTERM) 01:40:10.602564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25141): Terminating (SIGTERM) 01:40:10.641968 run iperf3-srv_10.42.42.10(pid=25142): Terminating (SIGTERM) 01:40:10.681281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25143): Terminating (SIGTERM) 01:40:10.721578 run iperf3-srv_10.42.42.10(pid=25144): Terminating (SIGTERM) 01:40:10.762258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25147): Terminating (SIGTERM) 01:40:10.802313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25150): Terminating (SIGTERM) 01:40:10.841738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25153): Terminating (SIGTERM) 01:40:10.881354 --- ParallelTerminationStrategy: PID 25134 died... 01:40:10.900064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25134): Terminated: ok {rc=0} 01:40:10.943713 --- ParallelTerminationStrategy: PID 25135 died... 01:40:10.962413 run iperf3-srv_10.42.42.10(pid=25135): Terminated {rc=256} 01:40:11.005662 --- ParallelTerminationStrategy: PID 25139 died... 01:40:11.024066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25139): Terminated: ok {rc=0} 01:40:11.067197 --- ParallelTerminationStrategy: PID 25140 died... 01:40:11.085537 run iperf3-srv_10.42.42.10(pid=25140): Terminated {rc=256} 01:40:11.129235 --- ParallelTerminationStrategy: PID 25141 died... 01:40:11.147586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25141): Terminated: ok {rc=0} 01:40:11.191048 --- ParallelTerminationStrategy: PID 25142 died... 01:40:11.209833 run iperf3-srv_10.42.42.10(pid=25142): Terminated {rc=256} 01:40:11.253075 --- ParallelTerminationStrategy: PID 25143 died... 01:40:11.271539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25143): Terminated: ok {rc=0} 01:40:11.314701 --- ParallelTerminationStrategy: PID 25144 died... 01:40:11.333104 run iperf3-srv_10.42.42.10(pid=25144): Terminated {rc=256} 01:40:11.376545 --- ParallelTerminationStrategy: PID 25147 died... 01:40:11.395258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25147): Terminated: ok {rc=0} 01:40:11.439038 --- ParallelTerminationStrategy: PID 25150 died... 01:40:11.457513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25150): Terminated: ok {rc=0} 01:40:11.500615 --- ParallelTerminationStrategy: PID 25153 died... 01:40:11.519164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25153): Terminated: ok {rc=0} 01:40:11.603949 bus /gobi_4: Setting Powered False 01:40:12.703684 bus /gobi_4: Setting Powered False 01:40:13.818852 bus /gobi_1: Setting Powered False 01:40:14.916941 bus /gobi_1: Setting Powered False 01:40:16.032020 bus /gobi_0: Setting Powered False 01:40:17.133354 bus /gobi_0: Setting Powered False 01:40:18.251941 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 01:40:19.355745 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:19.367503 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:40:19.437223 tst ping.py: using LAC 37658 01:40:19.555927 tst ping.py: using RAC 173 01:40:19.672761 tst ping.py: using CellId 37658 01:40:19.787192 tst ping.py: using BVCI 37659 01:40:19.894330 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:19.905539 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:19.916465 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:19.927350 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:19.938287 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:19.949224 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:19.960131 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:19.971045 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:40:20.084851 tst ping.py:19: start network... 01:40:20.281286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:40:20.738408 run create_hlr_db(pid=25155): Launched 01:40:20.859741 bus /gobi_6: Setting Powered False 01:40:21.919441 run create_hlr_db(pid=25155): Terminated: ok {rc=0} 01:40:22.353144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25157): Launched 01:40:22.671515 run osmo-hlr_10.42.42.2(pid=25158): Launched 01:40:22.794533 run osmo-stp_10.42.42.5: Starting osmo-stp 01:40:23.346952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25160): Launched 01:40:23.665936 run osmo-stp_10.42.42.5(pid=25161): Launched 01:40:23.789444 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:40:24.336116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25163): Launched 01:40:24.460471 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:40:24.728457 run patchelf(pid=25164): Launched 01:40:24.906612 run osmo-stp_10.42.42.5(pid=25161): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25161)] 01:40:25.040436 run osmo-stp_10.42.42.5(pid=25161): stdout: | (launched: 2022-12-14_01:40:23.607065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:25.176693 run osmo-stp_10.42.42.5(pid=25161): stderr: | [0;m[38;5;43m20221214014023798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014023798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014023798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014023799 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014023799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014023799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014023799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:25.312651 run osmo-stp_10.42.42.5(pid=25161): stdout: | (launched: 2022-12-14_01:40:23.607065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:25.442581 run osmo-stp_10.42.42.5(pid=25161): stderr: | [0;m[38;5;43m20221214014023798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014023798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014023798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014023799 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014023799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014023799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014023799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:25.596831 run patchelf(pid=25164): Terminating (SIGINT) 01:40:25.774330 run patchelf(pid=25164): Terminated: ok {rc=0} 01:40:25.901748 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25161): Process ended prematurely: osmo-stp_10.42.42.5(pid=25161) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25161)] [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 01:40:25.911392 tst ping.py:22: Test FAILED (6.5 sec) 01:40:25.939436 run osmo-hlr_10.42.42.2(pid=25158): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25158)] 01:40:25.989536 run osmo-hlr_10.42.42.2(pid=25158): stdout: | (launched: 2022-12-14_01:40:22.612847) 01:40:26.041191 run osmo-hlr_10.42.42.2(pid=25158): stderr: | [0;m[1;31m20221214014022808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014022808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014022808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014022808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014022808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014022808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014022820 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014022828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014022829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014022829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:40:26.092920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25157): Terminating (SIGTERM) 01:40:26.134668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25160): Terminating (SIGTERM) 01:40:26.176800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25163): Terminating (SIGTERM) 01:40:26.218898 --- ParallelTerminationStrategy: PID 25157 died... 01:40:26.239283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25157): Terminated: ok {rc=0} 01:40:26.285310 --- ParallelTerminationStrategy: PID 25160 died... 01:40:26.305130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25160): Terminated: ok {rc=0} 01:40:26.350822 --- ParallelTerminationStrategy: PID 25163 died... 01:40:26.370522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25163): Terminated: ok {rc=0} 01:40:26.458213 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 01:40:27.545665 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:27.558307 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 01:40:27.628267 tst ping_idle_ping.py: using LAC 37659 01:40:27.746644 tst ping_idle_ping.py: using RAC 174 01:40:27.865407 tst ping_idle_ping.py: using CellId 37659 01:40:27.988278 tst ping_idle_ping.py: using BVCI 37660 01:40:28.095812 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:28.107140 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:28.118082 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:28.128941 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:28.139800 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:28.150838 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:28.161815 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 01:40:28.172603 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 01:40:28.292187 tst ping_idle_ping.py:24: start network... 01:40:28.506214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:40:29.000705 run create_hlr_db(pid=25165): Launched 01:40:29.123052 bus /gobi_6: Setting Powered False 01:40:30.186381 run create_hlr_db(pid=25165): Terminated: ok {rc=0} 01:40:30.614003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25167): Launched 01:40:30.940537 run osmo-hlr_10.42.42.2(pid=25168): Launched 01:40:31.267455 run osmo-stp_10.42.42.5: Starting osmo-stp 01:40:31.920073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25170): Launched 01:40:32.224000 run osmo-stp_10.42.42.5(pid=25171): Launched 01:40:32.414762 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:40:32.968053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25173): Launched 01:40:33.092795 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:40:33.363782 run patchelf(pid=25174): Launched 01:40:33.541545 run osmo-stp_10.42.42.5(pid=25171): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25171)] 01:40:33.677195 run osmo-stp_10.42.42.5(pid=25171): stdout: | (launched: 2022-12-14_01:40:32.168404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:33.815010 run osmo-stp_10.42.42.5(pid=25171): stderr: | [0;m[38;5;43m20221214014032403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014032404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014032404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014032404 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014032405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014032405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014032405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:33.952150 run osmo-stp_10.42.42.5(pid=25171): stdout: | (launched: 2022-12-14_01:40:32.168404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:34.083264 run osmo-stp_10.42.42.5(pid=25171): stderr: | [0;m[38;5;43m20221214014032403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014032404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014032404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014032404 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014032405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014032405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014032405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:34.238223 run patchelf(pid=25174): Terminating (SIGINT) 01:40:34.416594 run patchelf(pid=25174): Terminated: ok {rc=0} 01:40:34.545664 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25171): Process ended prematurely: osmo-stp_10.42.42.5(pid=25171) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25171)] [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 01:40:34.555640 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 01:40:34.583927 run osmo-hlr_10.42.42.2(pid=25168): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25168)] 01:40:34.635698 run osmo-hlr_10.42.42.2(pid=25168): stdout: | (launched: 2022-12-14_01:40:30.877654) 01:40:34.688679 run osmo-hlr_10.42.42.2(pid=25168): stderr: | [0;m[1;31m20221214014031214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014031214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014031214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014031214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014031214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014031215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014031233 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014031254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014031254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014031254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:40:34.742575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25167): Terminating (SIGTERM) 01:40:34.784254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25170): Terminating (SIGTERM) 01:40:34.826954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25173): Terminating (SIGTERM) 01:40:34.870058 --- ParallelTerminationStrategy: PID 25167 died... 01:40:34.891039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25167): Terminated: ok {rc=0} 01:40:34.938005 --- ParallelTerminationStrategy: PID 25170 died... 01:40:34.958412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25170): Terminated: ok {rc=0} 01:40:35.005237 --- ParallelTerminationStrategy: PID 25173 died... 01:40:35.025526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25173): Terminated: ok {rc=0} 01:40:35.115389 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:40:36.419230 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:40:36.426303 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:40:36.455429 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:40:36.490178 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:40:36.542561 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:40:36.571659 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:40:36.606721 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:40:37.171838 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2397 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:40:37.178037 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:37.190430 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:40:37.259236 tst switch_tch_pdch.py: using LAC 37660 01:40:37.382820 tst switch_tch_pdch.py: using RAC 175 01:40:37.507481 tst switch_tch_pdch.py: using CellId 37660 01:40:37.631390 tst switch_tch_pdch.py: using BVCI 37661 01:40:37.746866 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:37.758754 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:37.770588 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:37.782329 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:37.794404 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:37.806483 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:37.818600 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:40:37.830503 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:40:37.946755 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:40:38.062296 tst switch_tch_pdch.py:51: start network... 01:40:38.259291 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:40:38.718809 run create_hlr_db(pid=25179): Launched 01:40:38.842126 bus /gobi_6: Setting Powered False 01:40:39.902633 run create_hlr_db(pid=25179): Terminated: ok {rc=0} 01:40:40.339358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25181): Launched 01:40:40.659267 run osmo-hlr_10.42.42.2(pid=25182): Launched 01:40:40.782607 run osmo-stp_10.42.42.5: Starting osmo-stp 01:40:41.334780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25184): Launched 01:40:41.654879 run osmo-stp_10.42.42.5(pid=25185): Launched 01:40:41.777730 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:40:42.327248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25187): Launched 01:40:42.450286 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:40:42.718705 run patchelf(pid=25188): Launched 01:40:42.896063 run osmo-stp_10.42.42.5(pid=25185): ERR: Terminated: ERROR {rc=1} [trial-2397↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25185)] 01:40:43.030244 run osmo-stp_10.42.42.5(pid=25185): stdout: | (launched: 2022-12-14_01:40:41.595489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:43.166195 run osmo-stp_10.42.42.5(pid=25185): stderr: | [0;m[38;5;43m20221214014041787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014041787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014041788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014041788 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014041788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014041789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014041789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:43.302265 run osmo-stp_10.42.42.5(pid=25185): stdout: | (launched: 2022-12-14_01:40:41.595489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:43.432256 run osmo-stp_10.42.42.5(pid=25185): stderr: | [0;m[38;5;43m20221214014041787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014041787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014041788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014041788 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014041788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014041789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014041789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:43.586249 run patchelf(pid=25188): Terminating (SIGINT) 01:40:43.764320 run patchelf(pid=25188): Terminated: ok {rc=0} 01:40:43.891676 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25185): Process ended prematurely: osmo-stp_10.42.42.5(pid=25185) [trial-2397↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25185)] [trial-2397↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:40:43.901370 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 01:40:43.929503 run osmo-hlr_10.42.42.2(pid=25182): ERR: Terminated: ERROR {rc=237} [trial-2397↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25182)] 01:40:43.980044 run osmo-hlr_10.42.42.2(pid=25182): stdout: | (launched: 2022-12-14_01:40:40.600493) 01:40:44.031896 run osmo-hlr_10.42.42.2(pid=25182): stderr: | [0;m[1;31m20221214014040798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014040798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014040798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014040798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014040798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014040798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014040810 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014040818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014040818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014040818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:40:44.084150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25181): Terminating (SIGTERM) 01:40:44.125502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25184): Terminating (SIGTERM) 01:40:44.167244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25187): Terminating (SIGTERM) 01:40:44.208998 --- ParallelTerminationStrategy: PID 25181 died... 01:40:44.229202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25181): Terminated: ok {rc=0} 01:40:44.275089 --- ParallelTerminationStrategy: PID 25184 died... 01:40:44.294904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25184): Terminated: ok {rc=0} 01:40:44.340616 --- ParallelTerminationStrategy: PID 25187 died... 01:40:44.360343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25187): Terminated: ok {rc=0} 01:40:44.447699 bus /gobi_0: Setting Powered False 01:40:45.544323 bus /gobi_0: Setting Powered False 01:40:46.668395 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 01:40:47.936031 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:40:47.942342 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 01:40:47.972305 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 01:40:48.008844 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 01:40:48.063547 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 01:40:48.093114 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 01:40:48.128448 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 01:40:48.686457 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2397 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 01:40:48.692275 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:40:48.703910 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 01:40:48.771724 tst switch_tch_pdch.py: using LAC 37661 01:40:48.896671 tst switch_tch_pdch.py: using RAC 176 01:40:49.020080 tst switch_tch_pdch.py: using CellId 37661 01:40:49.145045 tst switch_tch_pdch.py: using BVCI 37662 01:40:49.259813 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:40:49.271633 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:40:49.283192 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:40:49.294826 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:40:49.306750 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:40:49.318771 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:40:49.330904 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 01:40:49.342774 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:40:49.458246 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 01:40:49.576754 tst switch_tch_pdch.py:51: start network... 01:40:49.790723 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:40:50.252762 run create_hlr_db(pid=25194): Launched 01:40:50.374406 bus /gobi_6: Setting Powered False 01:40:51.437525 run create_hlr_db(pid=25194): Terminated: ok {rc=0} 01:40:51.838160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25196): Launched 01:40:52.137358 run osmo-hlr_10.42.42.2(pid=25197): Launched 01:40:52.249332 run osmo-stp_10.42.42.5: Starting osmo-stp 01:40:52.733714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25199): Launched 01:40:53.030928 run osmo-stp_10.42.42.5(pid=25200): Launched 01:40:53.143479 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:40:53.628692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25202): Launched 01:40:53.742554 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:40:53.990906 run patchelf(pid=25203): Launched 01:40:54.154773 run osmo-stp_10.42.42.5(pid=25200): ERR: Terminated: ERROR {rc=1} [trial-2397↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25200)] 01:40:54.279532 run osmo-stp_10.42.42.5(pid=25200): stdout: | (launched: 2022-12-14_01:40:52.974711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:54.405745 run osmo-stp_10.42.42.5(pid=25200): stderr: | [0;m[38;5;43m20221214014053145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014053145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014053146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014053146 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014053146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014053147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014053147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:54.531878 run osmo-stp_10.42.42.5(pid=25200): stdout: | (launched: 2022-12-14_01:40:52.974711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:40:54.651773 run osmo-stp_10.42.42.5(pid=25200): stderr: | [0;m[38;5;43m20221214014053145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014053145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014053146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014053146 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014053146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014053147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014053147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:40:54.794643 run patchelf(pid=25203): Terminating (SIGINT) 01:40:54.959365 run patchelf(pid=25203): Terminated: ok {rc=0} 01:40:55.078184 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25200): Process ended prematurely: osmo-stp_10.42.42.5(pid=25200) [trial-2397↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25200)] [trial-2397↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 01:40:55.087053 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 01:40:55.113561 run osmo-hlr_10.42.42.2(pid=25197): ERR: Terminated: ERROR {rc=237} [trial-2397↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25197)] 01:40:55.160685 run osmo-hlr_10.42.42.2(pid=25197): stdout: | (launched: 2022-12-14_01:40:52.081476) 01:40:55.209365 run osmo-hlr_10.42.42.2(pid=25197): stderr: | [0;m[1;31m20221214014052255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014052255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014052255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014052255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014052255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014052255 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014052267 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014052276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014052276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014052276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:40:55.258248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25196): Terminating (SIGTERM) 01:40:55.297158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25199): Terminating (SIGTERM) 01:40:55.335995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25202): Terminating (SIGTERM) 01:40:55.375253 --- ParallelTerminationStrategy: PID 25196 died... 01:40:55.394272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25196): Terminated: ok {rc=0} 01:40:55.437566 --- ParallelTerminationStrategy: PID 25199 died... 01:40:55.455864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25199): Terminated: ok {rc=0} 01:40:55.499187 --- ParallelTerminationStrategy: PID 25202 died... 01:40:55.517704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25202): Terminated: ok {rc=0} 01:40:55.603349 bus /gobi_0: Setting Powered False 01:40:56.702211 bus /gobi_0: Setting Powered False 01:40:57.818485 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 nitb_sms:nanobts --------------------------------------------------------------------- 01:40:59.063682 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:40:59.067743 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 01:40:59.091112 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 01:40:59.097790 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 01:40:59.151898 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 01:40:59.177652 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 01:40:59.184747 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 01:40:59.716152 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 01:40:59.722695 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 01:40:59.735972 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 01:40:59.775612 tst mo_mt_sms.py: using LAC 37662 01:40:59.901674 tst mo_mt_sms.py: using RAC 177 01:41:00.028625 tst mo_mt_sms.py: using CellId 37662 01:41:00.153236 tst mo_mt_sms.py: using BVCI 37663 01:41:00.261230 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 01:41:00.379596 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 01:41:00.494716 tst mo_mt_sms.py:9: start nitb and bts... 01:41:00.691225 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:41:01.321840 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25207): Launched 01:41:01.626441 run osmo-nitb_10.42.42.2(pid=25208): Launched 01:41:01.814954 run osmo-nitb_10.42.42.2(pid=25208): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25208)] 01:41:01.950374 run osmo-nitb_10.42.42.2(pid=25208): stdout: | (launched: 2022-12-14_01:41:01.570042) 01:41:02.087218 run osmo-nitb_10.42.42.2(pid=25208): stderr: | (launched: 2022-12-14_01:41:01.615184) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:41:02.223482 run osmo-nitb_10.42.42.2(pid=25208): stdout: | (launched: 2022-12-14_01:41:01.570042) 01:41:02.351571 run osmo-nitb_10.42.42.2(pid=25208): stderr: | (launched: 2022-12-14_01:41:01.615184) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8b7301f268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25208): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25208) [trial-2397↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25208)] 01:41:02.760432 tst osmo-nitb_10.42.42.2(pid=25208): stdout: | (launched: 2022-12-14_01:41:01.570042) 01:41:02.879359 tst osmo-nitb_10.42.42.2(pid=25208): stderr: | (launched: 2022-12-14_01:41:01.615184) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:41:03.019811 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=25208): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25208) [trial-2397↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25208)] [trial-2397↪nitb_sms:nanobts↪mo_mt_sms.py:11] 01:41:03.028247 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 01:41:03.034820 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25207): Terminating (SIGTERM) 01:41:03.243657 --- ParallelTerminationStrategy: PID 25207 died... 01:41:03.264160 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25207): Terminated: ok {rc=0} 01:41:03.350572 bus /sierra_3: Setting Powered False 01:41:04.449280 bus /sierra_3: Setting Powered False 01:41:05.564794 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 sms:nanobts+band-1900 --------------------------------------------------------------------- 01:41:06.748369 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:41:06.753244 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 01:41:06.776636 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 01:41:06.802735 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 01:41:06.855311 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 01:41:06.880370 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 01:41:06.908051 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 01:41:07.455970 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 01:41:07.461531 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:07.472761 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:41:07.512406 tst mo_mt_sms.py: using LAC 37663 01:41:07.637145 tst mo_mt_sms.py: using RAC 178 01:41:07.753191 tst mo_mt_sms.py: using CellId 37663 01:41:07.874002 tst mo_mt_sms.py: using BVCI 37664 01:41:07.981776 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:07.992552 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:08.003312 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:08.013922 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:08.024396 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:08.035528 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 01:41:08.153034 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 01:41:08.268295 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:41:08.728329 run create_hlr_db(pid=25212): Launched 01:41:08.850082 bus /sierra_2: Setting Powered False 01:41:09.909036 run create_hlr_db(pid=25212): Terminated: ok {rc=0} 01:41:10.323069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25214): Launched 01:41:10.619338 run osmo-hlr_10.42.42.2(pid=25215): Launched 01:41:10.731456 run osmo-stp_10.42.42.5: Starting osmo-stp 01:41:11.237722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25217): Launched 01:41:11.534540 run osmo-stp_10.42.42.5(pid=25218): Launched 01:41:11.646569 run osmo-msc_10.42.42.6: Starting osmo-msc 01:41:12.181318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25220): Launched 01:41:12.476707 run osmo-msc_10.42.42.6(pid=25221): Launched 01:41:12.641280 run osmo-stp_10.42.42.5(pid=25218): ERR: Terminated: ERROR {rc=1} [trial-2397↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25218)] 01:41:12.765416 run osmo-stp_10.42.42.5(pid=25218): stdout: | (launched: 2022-12-14_01:41:11.479038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:12.890476 run osmo-stp_10.42.42.5(pid=25218): stderr: | [0;m[38;5;43m20221214014111647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014111647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014111647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014111647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014111648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014111648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014111648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:13.012774 run osmo-stp_10.42.42.5(pid=25218): stdout: | (launched: 2022-12-14_01:41:11.479038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:13.129950 run osmo-stp_10.42.42.5(pid=25218): stderr: | [0;m[38;5;43m20221214014111647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014111647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014111647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014111647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014111648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014111648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014111648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:13.270413 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=25218): Process ended prematurely: osmo-stp_10.42.42.5(pid=25218) [trial-2397↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25218)] [trial-2397↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 01:41:13.278702 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 01:41:13.304401 run osmo-hlr_10.42.42.2(pid=25215): ERR: Terminated: ERROR {rc=237} [trial-2397↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25215)] 01:41:13.351126 run osmo-hlr_10.42.42.2(pid=25215): stdout: | (launched: 2022-12-14_01:41:10.563655) 01:41:13.399615 run osmo-hlr_10.42.42.2(pid=25215): stderr: | [0;m[1;31m20221214014110740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014110740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014110740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014110740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014110740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014110740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014110752 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014110763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014110763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014110763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:41:13.467116 run osmo-msc_10.42.42.6(pid=25221): ERR: Terminated: ERROR {rc=2} [trial-2397↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25221)] 01:41:13.513632 run osmo-msc_10.42.42.6(pid=25221): stdout: | (launched: 2022-12-14_01:41:12.421293) 01:41:13.561956 run osmo-msc_10.42.42.6(pid=25221): stderr: | [0;m[38;5;43m20221214014112695 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014112695 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9cff451c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014112696 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014112696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014112696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014112696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014112698 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014112698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014112698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014112698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:41:13.610636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25214): Terminating (SIGTERM) 01:41:13.649634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25217): Terminating (SIGTERM) 01:41:13.688511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25220): Terminating (SIGTERM) 01:41:13.727780 --- ParallelTerminationStrategy: PID 25214 died... 01:41:13.746654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25214): Terminated: ok {rc=0} 01:41:13.790054 --- ParallelTerminationStrategy: PID 25217 died... 01:41:13.808354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25217): Terminated: ok {rc=0} 01:41:13.851492 --- ParallelTerminationStrategy: PID 25220 died... 01:41:13.870166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25220): Terminated: ok {rc=0} 01:41:13.955200 bus /sierra_3: Setting Powered False 01:41:15.052599 bus /sierra_3: Setting Powered False 01:41:16.162812 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 01:41:17.383115 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:41:17.388109 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 01:41:17.411578 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 01:41:17.418292 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 01:41:17.453493 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 01:41:17.477407 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 01:41:17.484030 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 01:41:18.003892 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2397 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 01:41:18.008745 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 01:41:18.019662 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:41:18.056912 tst assert_extension.py: using LAC 37664 01:41:18.173766 tst assert_extension.py: using RAC 179 01:41:18.289371 tst assert_extension.py: using CellId 37664 01:41:18.406944 tst assert_extension.py: using BVCI 37665 01:41:18.513719 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 01:41:18.629654 tst assert_extension.py:10: start nitb and bts... 01:41:18.826500 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:41:19.428358 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25226): Launched 01:41:19.724545 run osmo-nitb_10.42.42.2(pid=25227): Launched 01:41:19.888217 run osmo-nitb_10.42.42.2(pid=25227): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25227)] 01:41:20.022494 run osmo-nitb_10.42.42.2(pid=25227): stdout: | (launched: 2022-12-14_01:41:19.669473) 01:41:20.157347 run osmo-nitb_10.42.42.2(pid=25227): stderr: | (launched: 2022-12-14_01:41:19.713372) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:41:20.292193 run osmo-nitb_10.42.42.2(pid=25227): stdout: | (launched: 2022-12-14_01:41:19.669473) 01:41:20.420822 run osmo-nitb_10.42.42.2(pid=25227): stderr: | (launched: 2022-12-14_01:41:19.713372) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8b7301f268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25227): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25227) [trial-2397↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25227)] 01:41:20.836517 tst osmo-nitb_10.42.42.2(pid=25227): stdout: | (launched: 2022-12-14_01:41:19.669473) 01:41:20.955514 tst osmo-nitb_10.42.42.2(pid=25227): stderr: | (launched: 2022-12-14_01:41:19.713372) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:41:21.096041 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=25227): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25227) [trial-2397↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25227)] [trial-2397↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 01:41:21.104434 tst assert_extension.py:12: Test FAILED (3.1 sec) 01:41:21.110957 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25226): Terminating (SIGTERM) 01:41:21.319928 --- ParallelTerminationStrategy: PID 25226 died... 01:41:21.340462 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25226): Terminated: ok {rc=0} 01:41:21.427684 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 ussd:nanobts+band-1900 --------------------------------------------------------------------- 01:41:22.594312 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:41:22.599047 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 01:41:22.622421 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 01:41:22.648610 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 01:41:22.683625 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 01:41:22.707145 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 01:41:22.733312 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 01:41:23.269982 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2397 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 01:41:23.275895 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:23.287651 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:41:23.325226 tst assert_extension.py: using LAC 37665 01:41:23.439591 tst assert_extension.py: using RAC 180 01:41:23.553639 tst assert_extension.py: using CellId 37665 01:41:23.667239 tst assert_extension.py: using BVCI 37666 01:41:23.773754 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:23.784427 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:23.795021 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:23.805509 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:23.816163 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:41:23.826973 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 01:41:23.940644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:41:24.399134 run create_hlr_db(pid=25231): Launched 01:41:24.521893 bus /sierra_2: Setting Powered False 01:41:25.581236 run create_hlr_db(pid=25231): Terminated: ok {rc=0} 01:41:25.996649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25233): Launched 01:41:26.293303 run osmo-hlr_10.42.42.2(pid=25234): Launched 01:41:26.405197 run osmo-stp_10.42.42.5: Starting osmo-stp 01:41:26.913958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25236): Launched 01:41:27.209861 run osmo-stp_10.42.42.5(pid=25237): Launched 01:41:27.322152 run osmo-msc_10.42.42.6: Starting osmo-msc 01:41:27.859075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25239): Launched 01:41:28.155742 run osmo-msc_10.42.42.6(pid=25240): Launched 01:41:28.321916 run osmo-stp_10.42.42.5(pid=25237): ERR: Terminated: ERROR {rc=1} [trial-2397↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25237)] 01:41:28.446069 run osmo-stp_10.42.42.5(pid=25237): stdout: | (launched: 2022-12-14_01:41:27.154536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:28.570426 run osmo-stp_10.42.42.5(pid=25237): stderr: | [0;m[38;5;43m20221214014127324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014127325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014127325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014127325 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014127326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014127326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014127326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:28.692643 run osmo-stp_10.42.42.5(pid=25237): stdout: | (launched: 2022-12-14_01:41:27.154536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:28.810380 run osmo-stp_10.42.42.5(pid=25237): stderr: | [0;m[38;5;43m20221214014127324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014127325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014127325 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014127325 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014127326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014127326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014127326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:28.950839 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=25237): Process ended prematurely: osmo-stp_10.42.42.5(pid=25237) [trial-2397↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25237)] [trial-2397↪ussd:nanobts+band-1900↪assert_extension.py:17] 01:41:28.959117 tst assert_extension.py:17: Test FAILED (5.7 sec) 01:41:28.985033 run osmo-hlr_10.42.42.2(pid=25234): ERR: Terminated: ERROR {rc=237} [trial-2397↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25234)] 01:41:29.032316 run osmo-hlr_10.42.42.2(pid=25234): stdout: | (launched: 2022-12-14_01:41:26.238099) 01:41:29.081798 run osmo-hlr_10.42.42.2(pid=25234): stderr: | [0;m[1;31m20221214014126413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014126413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014126413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014126413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014126413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014126413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014126425 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014126434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014126434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014126434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:41:29.150383 run osmo-msc_10.42.42.6(pid=25240): ERR: Terminated: ERROR {rc=2} [trial-2397↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25240)] 01:41:29.197669 run osmo-msc_10.42.42.6(pid=25240): stdout: | (launched: 2022-12-14_01:41:28.100463) 01:41:29.246534 run osmo-msc_10.42.42.6(pid=25240): stderr: | [0;m[38;5;43m20221214014128370 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014128370 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff4f2fa9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014128370 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014128370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014128371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014128371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014128373 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014128373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014128373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014128373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:41:29.295981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25233): Terminating (SIGTERM) 01:41:29.335446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25236): Terminating (SIGTERM) 01:41:29.374947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25239): Terminating (SIGTERM) 01:41:29.414854 --- ParallelTerminationStrategy: PID 25233 died... 01:41:29.434061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25233): Terminated: ok {rc=0} 01:41:29.477762 --- ParallelTerminationStrategy: PID 25236 died... 01:41:29.496235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25236): Terminated: ok {rc=0} 01:41:29.539720 --- ParallelTerminationStrategy: PID 25239 died... 01:41:29.558205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25239): Terminated: ok {rc=0} 01:41:29.643553 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 01:41:30.852893 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:41:30.862142 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 01:41:30.887803 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 01:41:30.919370 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 01:41:30.980419 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 01:41:31.015612 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 01:41:31.057142 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 01:41:31.576149 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 01:41:31.630167 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:31.642663 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:41:31.706281 tst mo_mt_call.py: using LAC 37666 01:41:31.826365 tst mo_mt_call.py: using RAC 181 01:41:31.997277 tst mo_mt_call.py: using CellId 37666 01:41:32.125747 tst mo_mt_call.py: using BVCI 37667 01:41:32.237782 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:32.250009 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:32.262317 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:32.274369 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:32.287331 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:32.300267 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:41:32.422143 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:41:32.544259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:41:33.044898 run create_hlr_db(pid=25245): Launched 01:41:33.169831 bus /sierra_2: Setting Powered False 01:41:34.233651 run create_hlr_db(pid=25245): Terminated: ok {rc=0} 01:41:34.666263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25247): Launched 01:41:34.967753 run osmo-hlr_10.42.42.2(pid=25248): Launched 01:41:35.082090 run osmo-stp_10.42.42.5: Starting osmo-stp 01:41:35.599709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25250): Launched 01:41:35.900127 run osmo-stp_10.42.42.5(pid=25251): Launched 01:41:36.013869 run osmo-msc_10.42.42.6: Starting osmo-msc 01:41:36.559991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25253): Launched 01:41:36.861858 run osmo-msc_10.42.42.6(pid=25254): Launched 01:41:37.030168 run osmo-stp_10.42.42.5(pid=25251): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25251)] 01:41:37.157556 run osmo-stp_10.42.42.5(pid=25251): stdout: | (launched: 2022-12-14_01:41:35.844157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:37.285215 run osmo-stp_10.42.42.5(pid=25251): stderr: | [0;m[38;5;43m20221214014136012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014136012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014136012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014136012 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014136013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014136013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014136013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:37.410587 run osmo-stp_10.42.42.5(pid=25251): stdout: | (launched: 2022-12-14_01:41:35.844157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:37.530603 run osmo-stp_10.42.42.5(pid=25251): stderr: | [0;m[38;5;43m20221214014136012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014136012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014136012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014136012 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014136013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014136013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014136013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:37.673882 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25251): Process ended prematurely: osmo-stp_10.42.42.5(pid=25251) [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25251)] [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 01:41:37.682883 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:41:37.709217 run osmo-hlr_10.42.42.2(pid=25248): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25248)] 01:41:37.756210 run osmo-hlr_10.42.42.2(pid=25248): stdout: | (launched: 2022-12-14_01:41:34.911806) 01:41:37.805062 run osmo-hlr_10.42.42.2(pid=25248): stderr: | [0;m[1;31m20221214014135085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014135085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014135085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014135085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014135085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014135086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014135099 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014135108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014135108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014135108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:41:37.872789 run osmo-msc_10.42.42.6(pid=25254): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25254)] 01:41:37.919805 run osmo-msc_10.42.42.6(pid=25254): stdout: | (launched: 2022-12-14_01:41:36.805763) 01:41:37.968003 run osmo-msc_10.42.42.6(pid=25254): stderr: | [0;m[38;5;43m20221214014137077 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014137077 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd04832ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014137077 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014137077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014137077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014137077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014137079 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014137079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014137080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014137080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:41:38.016745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25247): Terminating (SIGTERM) 01:41:38.055482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25250): Terminating (SIGTERM) 01:41:38.094926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25253): Terminating (SIGTERM) 01:41:38.133975 --- ParallelTerminationStrategy: PID 25247 died... 01:41:38.153108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25247): Terminated: ok {rc=0} 01:41:38.196463 --- ParallelTerminationStrategy: PID 25250 died... 01:41:38.214776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25250): Terminated: ok {rc=0} 01:41:38.258206 --- ParallelTerminationStrategy: PID 25253 died... 01:41:38.276515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25253): Terminated: ok {rc=0} 01:41:38.361066 bus /sierra_3: Setting Powered False 01:41:39.459848 bus /sierra_3: Setting Powered False 01:41:40.574059 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 01:41:41.719141 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:41.731147 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:41:41.791531 tst mo_mt_call_osmux.py: using LAC 37667 01:41:41.908937 tst mo_mt_call_osmux.py: using RAC 182 01:41:42.030078 tst mo_mt_call_osmux.py: using CellId 37667 01:41:42.148071 tst mo_mt_call_osmux.py: using BVCI 37668 01:41:42.256716 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:42.268036 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:42.279183 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:42.290330 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:42.301564 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:41:42.312553 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:41:42.428374 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:41:42.548807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:41:43.017277 run create_hlr_db(pid=25256): Launched 01:41:43.140140 bus /sierra_2: Setting Powered False 01:41:44.200903 run create_hlr_db(pid=25256): Terminated: ok {rc=0} 01:41:44.620698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25258): Launched 01:41:44.922528 run osmo-hlr_10.42.42.2(pid=25259): Launched 01:41:45.037230 run osmo-stp_10.42.42.5: Starting osmo-stp 01:41:45.562313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25261): Launched 01:41:45.870237 run osmo-stp_10.42.42.5(pid=25262): Launched 01:41:46.147641 run osmo-msc_10.42.42.6: Starting osmo-msc 01:41:46.851662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25265): Launched 01:41:47.252821 run osmo-msc_10.42.42.6(pid=25266): Launched 01:41:47.458775 run osmo-stp_10.42.42.5(pid=25262): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25262)] 01:41:47.603527 run osmo-stp_10.42.42.5(pid=25262): stdout: | (launched: 2022-12-14_01:41:45.807467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:47.745547 run osmo-stp_10.42.42.5(pid=25262): stderr: | [0;m[38;5;43m20221214014146046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014146046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014146046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014146047 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014146047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014146047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014146047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:47.885285 run osmo-stp_10.42.42.5(pid=25262): stdout: | (launched: 2022-12-14_01:41:45.807467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:48.015295 run osmo-stp_10.42.42.5(pid=25262): stderr: | [0;m[38;5;43m20221214014146046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014146046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014146046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014146047 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014146047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014146047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014146047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:48.170296 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25262): Process ended prematurely: osmo-stp_10.42.42.5(pid=25262) [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25262)] [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 01:41:48.180414 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 01:41:48.208661 run osmo-hlr_10.42.42.2(pid=25259): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25259)] 01:41:48.259851 run osmo-hlr_10.42.42.2(pid=25259): stdout: | (launched: 2022-12-14_01:41:44.866442) 01:41:48.312176 run osmo-hlr_10.42.42.2(pid=25259): stderr: | [0;m[1;31m20221214014145041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014145041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014145041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014145041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014145041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014145041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014145053 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014145062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014145062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014145062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:41:48.384718 run osmo-msc_10.42.42.6(pid=25266): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25266)] 01:41:48.434349 run osmo-msc_10.42.42.6(pid=25266): stdout: | (launched: 2022-12-14_01:41:47.191398) 01:41:48.486766 run osmo-msc_10.42.42.6(pid=25266): stderr: | [0;m[38;5;43m20221214014147669 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014147669 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3b7b47cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014147669 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014147669 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014147670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014147670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014147671 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014147672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014147672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014147672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:41:48.539458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25258): Terminating (SIGTERM) 01:41:48.581523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25261): Terminating (SIGTERM) 01:41:48.624089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25265): Terminating (SIGTERM) 01:41:48.666694 --- ParallelTerminationStrategy: PID 25258 died... 01:41:48.687399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25258): Terminated: ok {rc=0} 01:41:48.734480 --- ParallelTerminationStrategy: PID 25261 died... 01:41:48.754640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25261): Terminated: ok {rc=0} 01:41:48.801179 --- ParallelTerminationStrategy: PID 25265 died... 01:41:48.821326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25265): Terminated: ok {rc=0} 01:41:48.910271 bus /sierra_3: Setting Powered False 01:41:50.008436 bus /sierra_3: Setting Powered False 01:41:51.124400 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 01:41:52.374356 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:41:52.382561 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 01:41:52.406847 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 01:41:52.435414 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 01:41:52.488570 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 01:41:52.512287 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 01:41:52.538617 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 01:41:53.093696 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 01:41:53.146023 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:41:53.157695 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:41:53.216912 tst mo_mt_call.py: using LAC 37668 01:41:53.341630 tst mo_mt_call.py: using RAC 183 01:41:53.466311 tst mo_mt_call.py: using CellId 37668 01:41:53.590602 tst mo_mt_call.py: using BVCI 37669 01:41:53.707342 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:41:53.719034 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:41:53.730985 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:41:53.742648 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:41:53.754698 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:41:53.766516 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:41:53.883320 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:41:54.002777 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:41:54.502345 run create_hlr_db(pid=25271): Launched 01:41:54.625482 bus /sierra_2: Setting Powered False 01:41:55.689104 run create_hlr_db(pid=25271): Terminated: ok {rc=0} 01:41:56.139834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25273): Launched 01:41:56.463921 run osmo-hlr_10.42.42.2(pid=25274): Launched 01:41:56.587565 run osmo-stp_10.42.42.5: Starting osmo-stp 01:41:57.149518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25276): Launched 01:41:57.458425 run osmo-stp_10.42.42.5(pid=25277): Launched 01:41:57.572673 run osmo-msc_10.42.42.6: Starting osmo-msc 01:41:58.117538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25279): Launched 01:41:58.422893 run osmo-msc_10.42.42.6(pid=25280): Launched 01:41:58.591929 run osmo-stp_10.42.42.5(pid=25277): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25277)] 01:41:58.718664 run osmo-stp_10.42.42.5(pid=25277): stdout: | (launched: 2022-12-14_01:41:57.401602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:58.845256 run osmo-stp_10.42.42.5(pid=25277): stderr: | [0;m[38;5;43m20221214014157573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014157573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014157573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014157574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014157574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014157574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014157574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:58.970767 run osmo-stp_10.42.42.5(pid=25277): stdout: | (launched: 2022-12-14_01:41:57.401602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:41:59.090196 run osmo-stp_10.42.42.5(pid=25277): stderr: | [0;m[38;5;43m20221214014157573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014157573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014157573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014157574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014157574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014157574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014157574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:41:59.233175 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25277): Process ended prematurely: osmo-stp_10.42.42.5(pid=25277) [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25277)] [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 01:41:59.242307 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:41:59.268418 run osmo-hlr_10.42.42.2(pid=25274): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25274)] 01:41:59.315203 run osmo-hlr_10.42.42.2(pid=25274): stdout: | (launched: 2022-12-14_01:41:56.403837) 01:41:59.363614 run osmo-hlr_10.42.42.2(pid=25274): stderr: | [0;m[1;31m20221214014156601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014156601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014156601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014156601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014156601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014156601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014156613 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014156621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014156621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014156621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:41:59.431235 run osmo-msc_10.42.42.6(pid=25280): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25280)] 01:41:59.478019 run osmo-msc_10.42.42.6(pid=25280): stdout: | (launched: 2022-12-14_01:41:58.365661) 01:41:59.526343 run osmo-msc_10.42.42.6(pid=25280): stderr: | [0;m[38;5;43m20221214014158636 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014158636 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb69b19dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014158637 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014158637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014158637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014158637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014158639 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014158639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014158639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014158639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:41:59.574826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25273): Terminating (SIGTERM) 01:41:59.614566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25276): Terminating (SIGTERM) 01:41:59.653842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25279): Terminating (SIGTERM) 01:41:59.693288 --- ParallelTerminationStrategy: PID 25273 died... 01:41:59.712221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25273): Terminated: ok {rc=0} 01:41:59.755522 --- ParallelTerminationStrategy: PID 25276 died... 01:41:59.773992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25276): Terminated: ok {rc=0} 01:41:59.817159 --- ParallelTerminationStrategy: PID 25279 died... 01:41:59.835629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25279): Terminated: ok {rc=0} 01:41:59.921002 bus /sierra_3: Setting Powered False 01:42:01.038977 bus /sierra_3: Setting Powered False 01:42:02.184722 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 01:42:03.338245 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:42:03.351325 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:42:03.415224 tst mo_mt_call_osmux.py: using LAC 37669 01:42:03.542635 tst mo_mt_call_osmux.py: using RAC 184 01:42:03.670952 tst mo_mt_call_osmux.py: using CellId 37669 01:42:03.805465 tst mo_mt_call_osmux.py: using BVCI 37670 01:42:03.915929 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:42:03.927235 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:42:03.938277 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:42:03.949405 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:42:03.960536 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:42:03.971933 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:42:04.094173 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:42:04.210579 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:42:04.679271 run create_hlr_db(pid=25288): Launched 01:42:04.804018 bus /sierra_2: Setting Powered False 01:42:05.863675 run create_hlr_db(pid=25288): Terminated: ok {rc=0} 01:42:06.283755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25290): Launched 01:42:06.585618 run osmo-hlr_10.42.42.2(pid=25291): Launched 01:42:06.700119 run osmo-stp_10.42.42.5: Starting osmo-stp 01:42:07.236375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25293): Launched 01:42:07.537819 run osmo-stp_10.42.42.5(pid=25294): Launched 01:42:07.652598 run osmo-msc_10.42.42.6: Starting osmo-msc 01:42:08.200199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25296): Launched 01:42:08.503253 run osmo-msc_10.42.42.6(pid=25297): Launched 01:42:08.671311 run osmo-stp_10.42.42.5(pid=25294): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25294)] 01:42:08.798979 run osmo-stp_10.42.42.5(pid=25294): stdout: | (launched: 2022-12-14_01:42:07.481708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:08.925746 run osmo-stp_10.42.42.5(pid=25294): stderr: | [0;m[38;5;43m20221214014207654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014207654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014207654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014207654 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014207655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014207655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014207655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:09.050725 run osmo-stp_10.42.42.5(pid=25294): stdout: | (launched: 2022-12-14_01:42:07.481708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:09.170065 run osmo-stp_10.42.42.5(pid=25294): stderr: | [0;m[38;5;43m20221214014207654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014207654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014207654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014207654 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014207655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014207655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014207655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:09.313779 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25294): Process ended prematurely: osmo-stp_10.42.42.5(pid=25294) [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25294)] [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 01:42:09.322747 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 01:42:09.348859 run osmo-hlr_10.42.42.2(pid=25291): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25291)] 01:42:09.395569 run osmo-hlr_10.42.42.2(pid=25291): stdout: | (launched: 2022-12-14_01:42:06.529089) 01:42:09.443915 run osmo-hlr_10.42.42.2(pid=25291): stderr: | [0;m[1;31m20221214014206705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014206705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014206705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014206705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014206706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014206706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014206718 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014206726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014206727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014206727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:42:09.511989 run osmo-msc_10.42.42.6(pid=25297): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25297)] 01:42:09.558728 run osmo-msc_10.42.42.6(pid=25297): stdout: | (launched: 2022-12-14_01:42:08.446668) 01:42:09.607115 run osmo-msc_10.42.42.6(pid=25297): stderr: | [0;m[38;5;43m20221214014208717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014208717 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f94a7927c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014208717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014208717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014208717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014208717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014208719 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014208720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014208720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014208720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:42:09.655970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25290): Terminating (SIGTERM) 01:42:09.694767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25293): Terminating (SIGTERM) 01:42:09.733436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25296): Terminating (SIGTERM) 01:42:09.772915 --- ParallelTerminationStrategy: PID 25290 died... 01:42:09.791766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25290): Terminated: ok {rc=0} 01:42:09.834693 --- ParallelTerminationStrategy: PID 25293 died... 01:42:09.852996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25293): Terminated: ok {rc=0} 01:42:09.895841 --- ParallelTerminationStrategy: PID 25296 died... 01:42:09.914257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25296): Terminated: ok {rc=0} 01:42:09.998977 bus /sierra_3: Setting Powered False 01:42:11.097061 bus /sierra_3: Setting Powered False 01:42:12.211526 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 01:42:13.452094 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:42:13.459717 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 01:42:13.483315 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 01:42:13.509789 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 01:42:13.561024 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 01:42:13.584632 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 01:42:13.610904 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 01:42:14.168156 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 01:42:14.218397 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:14.229851 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:42:14.287761 tst mo_mt_call.py: using LAC 37670 01:42:14.407249 tst mo_mt_call.py: using RAC 185 01:42:14.525038 tst mo_mt_call.py: using CellId 37670 01:42:14.641418 tst mo_mt_call.py: using BVCI 37671 01:42:14.752295 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:14.763633 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:14.774698 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:14.785746 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:14.796890 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:14.807886 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:42:14.927287 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:42:15.043121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:42:15.509302 run create_hlr_db(pid=25302): Launched 01:42:15.632864 bus /sierra_2: Setting Powered False 01:42:16.706327 run create_hlr_db(pid=25302): Terminated: ok {rc=0} 01:42:17.213992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25304): Launched 01:42:17.551932 run osmo-hlr_10.42.42.2(pid=25305): Launched 01:42:17.678674 run osmo-stp_10.42.42.5: Starting osmo-stp 01:42:18.236274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25307): Launched 01:42:18.562907 run osmo-stp_10.42.42.5(pid=25308): Launched 01:42:18.687760 run osmo-msc_10.42.42.6: Starting osmo-msc 01:42:19.272793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25310): Launched 01:42:19.599221 run osmo-msc_10.42.42.6(pid=25311): Launched 01:42:19.780535 run osmo-stp_10.42.42.5(pid=25308): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25308)] 01:42:19.915790 run osmo-stp_10.42.42.5(pid=25308): stdout: | (launched: 2022-12-14_01:42:18.502830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:20.052439 run osmo-stp_10.42.42.5(pid=25308): stderr: | [0;m[38;5;43m20221214014218693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014218693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014218693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014218694 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014218694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014218694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014218694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:20.187821 run osmo-stp_10.42.42.5(pid=25308): stdout: | (launched: 2022-12-14_01:42:18.502830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:20.316277 run osmo-stp_10.42.42.5(pid=25308): stderr: | [0;m[38;5;43m20221214014218693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014218693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014218693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014218694 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014218694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014218694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014218694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:20.470435 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25308): Process ended prematurely: osmo-stp_10.42.42.5(pid=25308) [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25308)] [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 01:42:20.480098 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:42:20.507797 run osmo-hlr_10.42.42.2(pid=25305): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25305)] 01:42:20.557617 run osmo-hlr_10.42.42.2(pid=25305): stdout: | (launched: 2022-12-14_01:42:17.491862) 01:42:20.609097 run osmo-hlr_10.42.42.2(pid=25305): stderr: | [0;m[1;31m20221214014217687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014217687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014217687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014217687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014217687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014217687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014217700 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014217708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014217708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014217708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:42:20.680850 run osmo-msc_10.42.42.6(pid=25311): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25311)] 01:42:20.730402 run osmo-msc_10.42.42.6(pid=25311): stdout: | (launched: 2022-12-14_01:42:19.539063) 01:42:20.782031 run osmo-msc_10.42.42.6(pid=25311): stderr: | [0;m[38;5;43m20221214014219861 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014219861 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f745b85ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014219861 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014219861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014219861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014219862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014219863 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014219863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014219864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014219864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:42:20.833736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25304): Terminating (SIGTERM) 01:42:20.875180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25307): Terminating (SIGTERM) 01:42:20.916900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25310): Terminating (SIGTERM) 01:42:20.959317 --- ParallelTerminationStrategy: PID 25304 died... 01:42:20.979412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25304): Terminated: ok {rc=0} 01:42:21.025415 --- ParallelTerminationStrategy: PID 25307 died... 01:42:21.045083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25307): Terminated: ok {rc=0} 01:42:21.090484 --- ParallelTerminationStrategy: PID 25310 died... 01:42:21.110161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25310): Terminated: ok {rc=0} 01:42:21.197899 bus /sierra_3: Setting Powered False 01:42:22.296399 bus /sierra_3: Setting Powered False 01:42:23.415058 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 01:42:24.559830 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:24.571777 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:42:24.632519 tst mo_mt_call_osmux.py: using LAC 37671 01:42:24.750732 tst mo_mt_call_osmux.py: using RAC 186 01:42:24.870537 tst mo_mt_call_osmux.py: using CellId 37671 01:42:24.989355 tst mo_mt_call_osmux.py: using BVCI 37672 01:42:25.097617 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:25.108753 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:25.119779 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:25.130796 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:25.141889 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:42:25.152823 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:42:25.268270 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:42:25.388314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:42:25.856466 run create_hlr_db(pid=25313): Launched 01:42:25.979255 bus /sierra_2: Setting Powered False 01:42:27.039038 run create_hlr_db(pid=25313): Terminated: ok {rc=0} 01:42:27.478860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25315): Launched 01:42:27.806933 run osmo-hlr_10.42.42.2(pid=25316): Launched 01:42:27.931397 run osmo-stp_10.42.42.5: Starting osmo-stp 01:42:28.490306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25318): Launched 01:42:28.814821 run osmo-stp_10.42.42.5(pid=25319): Launched 01:42:28.939032 run osmo-msc_10.42.42.6: Starting osmo-msc 01:42:29.529916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25321): Launched 01:42:29.856000 run osmo-msc_10.42.42.6(pid=25322): Launched 01:42:30.038989 run osmo-stp_10.42.42.5(pid=25319): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25319)] 01:42:30.176376 run osmo-stp_10.42.42.5(pid=25319): stdout: | (launched: 2022-12-14_01:42:28.754949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:30.314132 run osmo-stp_10.42.42.5(pid=25319): stderr: | [0;m[38;5;43m20221214014228946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014228947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014228947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014228947 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014228948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014228948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014228948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:30.449169 run osmo-stp_10.42.42.5(pid=25319): stdout: | (launched: 2022-12-14_01:42:28.754949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:30.578476 run osmo-stp_10.42.42.5(pid=25319): stderr: | [0;m[38;5;43m20221214014228946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014228947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014228947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014228947 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014228948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014228948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014228948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:30.732855 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25319): Process ended prematurely: osmo-stp_10.42.42.5(pid=25319) [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25319)] [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 01:42:30.742803 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:42:30.771032 run osmo-hlr_10.42.42.2(pid=25316): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25316)] 01:42:30.821202 run osmo-hlr_10.42.42.2(pid=25316): stdout: | (launched: 2022-12-14_01:42:27.747126) 01:42:30.879281 run osmo-hlr_10.42.42.2(pid=25316): stderr: | [0;m[1;31m20221214014227944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014227944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014227944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014227944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014227944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014227944 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014227957 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014227965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014227965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014227965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:42:30.955587 run osmo-msc_10.42.42.6(pid=25322): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25322)] 01:42:31.005783 run osmo-msc_10.42.42.6(pid=25322): stdout: | (launched: 2022-12-14_01:42:29.795874) 01:42:31.055756 run osmo-msc_10.42.42.6(pid=25322): stderr: | [0;m[38;5;43m20221214014230116 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014230116 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fba99deac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014230116 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014230116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014230116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014230116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014230118 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014230118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014230118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014230119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:42:31.106629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25315): Terminating (SIGTERM) 01:42:31.147751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25318): Terminating (SIGTERM) 01:42:31.190362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25321): Terminating (SIGTERM) 01:42:31.233422 --- ParallelTerminationStrategy: PID 25315 died... 01:42:31.253305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25315): Terminated: ok {rc=0} 01:42:31.299831 --- ParallelTerminationStrategy: PID 25318 died... 01:42:31.319704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25318): Terminated: ok {rc=0} 01:42:31.364860 --- ParallelTerminationStrategy: PID 25321 died... 01:42:31.384539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25321): Terminated: ok {rc=0} 01:42:31.469636 bus /sierra_3: Setting Powered False 01:42:32.566986 bus /sierra_3: Setting Powered False 01:42:33.681130 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:42:34.924802 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:42:34.932829 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:42:34.957401 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:42:34.986073 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:42:35.038766 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:42:35.063222 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:42:35.091310 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:42:35.645199 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:42:35.698411 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:35.710331 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:42:35.773090 tst mo_mt_call.py: using LAC 37672 01:42:35.900227 tst mo_mt_call.py: using RAC 187 01:42:36.032303 tst mo_mt_call.py: using CellId 37672 01:42:36.159640 tst mo_mt_call.py: using BVCI 37673 01:42:36.276827 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:36.288697 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:36.300368 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:36.312339 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:36.324680 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:36.337220 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:42:36.456064 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:42:36.574925 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:42:37.074954 run create_hlr_db(pid=25328): Launched 01:42:37.198152 bus /sierra_2: Setting Powered False 01:42:38.261353 run create_hlr_db(pid=25328): Terminated: ok {rc=0} 01:42:38.692753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25330): Launched 01:42:38.995188 run osmo-hlr_10.42.42.2(pid=25331): Launched 01:42:39.109448 run osmo-stp_10.42.42.5: Starting osmo-stp 01:42:39.654323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25333): Launched 01:42:39.980469 run osmo-stp_10.42.42.5(pid=25334): Launched 01:42:40.105175 run osmo-msc_10.42.42.6: Starting osmo-msc 01:42:40.688921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25336): Launched 01:42:41.014184 run osmo-msc_10.42.42.6(pid=25337): Launched 01:42:41.193732 run osmo-stp_10.42.42.5(pid=25334): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25334)] 01:42:41.329379 run osmo-stp_10.42.42.5(pid=25334): stdout: | (launched: 2022-12-14_01:42:39.920675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:41.466020 run osmo-stp_10.42.42.5(pid=25334): stderr: | [0;m[38;5;43m20221214014240112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014240112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014240113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014240113 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014240113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014240114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014240114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:41.601775 run osmo-stp_10.42.42.5(pid=25334): stdout: | (launched: 2022-12-14_01:42:39.920675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:41.729572 run osmo-stp_10.42.42.5(pid=25334): stderr: | [0;m[38;5;43m20221214014240112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014240112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014240113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014240113 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014240113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014240114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014240114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:41.883341 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25334): Process ended prematurely: osmo-stp_10.42.42.5(pid=25334) [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25334)] [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:42:41.892885 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 01:42:41.920458 run osmo-hlr_10.42.42.2(pid=25331): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25331)] 01:42:41.970197 run osmo-hlr_10.42.42.2(pid=25331): stdout: | (launched: 2022-12-14_01:42:38.938495) 01:42:42.021615 run osmo-hlr_10.42.42.2(pid=25331): stderr: | [0;m[1;31m20221214014239114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014239114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014239114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014239114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014239114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014239114 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014239126 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014239135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014239136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014239136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:42:42.093323 run osmo-msc_10.42.42.6(pid=25337): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25337)] 01:42:42.142690 run osmo-msc_10.42.42.6(pid=25337): stdout: | (launched: 2022-12-14_01:42:40.954353) 01:42:42.194280 run osmo-msc_10.42.42.6(pid=25337): stderr: | [0;m[38;5;43m20221214014241274 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014241274 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe524a93c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014241274 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014241274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014241275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014241275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014241276 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014241277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014241277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014241277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:42:42.245612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25330): Terminating (SIGTERM) 01:42:42.286924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25333): Terminating (SIGTERM) 01:42:42.328344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25336): Terminating (SIGTERM) 01:42:42.370582 --- ParallelTerminationStrategy: PID 25330 died... 01:42:42.390628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25330): Terminated: ok {rc=0} 01:42:42.436201 --- ParallelTerminationStrategy: PID 25333 died... 01:42:42.455803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25333): Terminated: ok {rc=0} 01:42:42.501386 --- ParallelTerminationStrategy: PID 25336 died... 01:42:42.521132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25336): Terminated: ok {rc=0} 01:42:42.607762 bus /sierra_3: Setting Powered False 01:42:43.707812 bus /sierra_3: Setting Powered False 01:42:44.822211 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:42:45.991498 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:46.005694 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:42:46.071477 tst mo_mt_call_osmux.py: using LAC 37673 01:42:46.226906 tst mo_mt_call_osmux.py: using RAC 188 01:42:46.355437 tst mo_mt_call_osmux.py: using CellId 37673 01:42:46.487627 tst mo_mt_call_osmux.py: using BVCI 37674 01:42:46.610765 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:46.623744 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:46.637290 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:46.650282 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:46.666385 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:42:46.680283 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:42:46.825177 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:42:46.986552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:42:47.476843 run create_hlr_db(pid=25339): Launched 01:42:47.600889 bus /sierra_2: Setting Powered False 01:42:48.661675 run create_hlr_db(pid=25339): Terminated: ok {rc=0} 01:42:49.102475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25341): Launched 01:42:49.429187 run osmo-hlr_10.42.42.2(pid=25342): Launched 01:42:49.551826 run osmo-stp_10.42.42.5: Starting osmo-stp 01:42:50.110263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25344): Launched 01:42:50.434251 run osmo-stp_10.42.42.5(pid=25345): Launched 01:42:50.559056 run osmo-msc_10.42.42.6: Starting osmo-msc 01:42:51.146240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25347): Launched 01:42:51.472034 run osmo-msc_10.42.42.6(pid=25348): Launched 01:42:51.654044 run osmo-stp_10.42.42.5(pid=25345): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25345)] 01:42:51.792217 run osmo-stp_10.42.42.5(pid=25345): stdout: | (launched: 2022-12-14_01:42:50.374474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:51.929610 run osmo-stp_10.42.42.5(pid=25345): stderr: | [0;m[38;5;43m20221214014250567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014250567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014250567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014250567 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014250568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014250568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014250568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:52.065427 run osmo-stp_10.42.42.5(pid=25345): stdout: | (launched: 2022-12-14_01:42:50.374474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:42:52.194307 run osmo-stp_10.42.42.5(pid=25345): stderr: | [0;m[38;5;43m20221214014250567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014250567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014250567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014250567 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014250568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014250568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014250568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:42:52.347756 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25345): Process ended prematurely: osmo-stp_10.42.42.5(pid=25345) [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25345)] [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:42:52.357576 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 01:42:52.385247 run osmo-hlr_10.42.42.2(pid=25342): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25342)] 01:42:52.435380 run osmo-hlr_10.42.42.2(pid=25342): stdout: | (launched: 2022-12-14_01:42:49.368926) 01:42:52.487121 run osmo-hlr_10.42.42.2(pid=25342): stderr: | [0;m[1;31m20221214014249567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014249568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014249568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014249568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014249568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014249568 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014249580 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014249588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014249588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014249588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:42:52.559534 run osmo-msc_10.42.42.6(pid=25348): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25348)] 01:42:52.609085 run osmo-msc_10.42.42.6(pid=25348): stdout: | (launched: 2022-12-14_01:42:51.412116) 01:42:52.660687 run osmo-msc_10.42.42.6(pid=25348): stderr: | [0;m[38;5;43m20221214014251731 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014251732 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f62b4ea9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014251732 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014251732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014251732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014251732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014251734 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014251735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014251735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014251735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:42:52.712283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25341): Terminating (SIGTERM) 01:42:52.753922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25344): Terminating (SIGTERM) 01:42:52.795657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25347): Terminating (SIGTERM) 01:42:52.837404 --- ParallelTerminationStrategy: PID 25341 died... 01:42:52.857475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25341): Terminated: ok {rc=0} 01:42:52.903254 --- ParallelTerminationStrategy: PID 25344 died... 01:42:52.922661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25344): Terminated: ok {rc=0} 01:42:52.968510 --- ParallelTerminationStrategy: PID 25347 died... 01:42:52.988202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25347): Terminated: ok {rc=0} 01:42:53.076892 bus /sierra_3: Setting Powered False 01:42:54.175395 bus /sierra_3: Setting Powered False 01:42:55.294081 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:42:56.543188 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:42:56.553112 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:42:56.577418 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:42:56.605523 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:42:56.666099 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:42:56.691730 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:42:56.719597 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:42:57.267290 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:42:57.319621 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:42:57.331615 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:42:57.394348 tst mo_mt_call.py: using LAC 37674 01:42:57.521369 tst mo_mt_call.py: using RAC 189 01:42:57.646332 tst mo_mt_call.py: using CellId 37674 01:42:57.775923 tst mo_mt_call.py: using BVCI 37675 01:42:57.894470 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:42:57.906497 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:42:57.918237 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:42:57.929844 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:42:57.941859 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:42:57.954204 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:42:58.069956 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:42:58.190273 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:42:58.690307 run create_hlr_db(pid=25353): Launched 01:42:58.815347 bus /sierra_2: Setting Powered False 01:42:59.878054 run create_hlr_db(pid=25353): Terminated: ok {rc=0} 01:43:00.329239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25355): Launched 01:43:00.654600 run osmo-hlr_10.42.42.2(pid=25356): Launched 01:43:00.779643 run osmo-stp_10.42.42.5: Starting osmo-stp 01:43:01.489422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25358): Launched 01:43:01.831930 run osmo-stp_10.42.42.5(pid=25359): Launched 01:43:02.076678 run osmo-msc_10.42.42.6: Starting osmo-msc 01:43:02.663499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25361): Launched 01:43:02.967202 run osmo-msc_10.42.42.6(pid=25362): Launched 01:43:03.136941 run osmo-stp_10.42.42.5(pid=25359): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25359)] 01:43:03.264023 run osmo-stp_10.42.42.5(pid=25359): stdout: | (launched: 2022-12-14_01:43:01.769368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:03.391299 run osmo-stp_10.42.42.5(pid=25359): stderr: | [0;m[38;5;43m20221214014302062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014302062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014302062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014302063 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014302063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014302063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014302063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:03.516182 run osmo-stp_10.42.42.5(pid=25359): stdout: | (launched: 2022-12-14_01:43:01.769368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:03.635436 run osmo-stp_10.42.42.5(pid=25359): stderr: | [0;m[38;5;43m20221214014302062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014302062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014302062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014302063 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014302063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014302063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014302063 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:03.778034 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25359): Process ended prematurely: osmo-stp_10.42.42.5(pid=25359) [trial-2397↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25359)] [trial-2397↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:43:03.787035 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 01:43:03.813399 run osmo-hlr_10.42.42.2(pid=25356): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25356)] 01:43:03.860717 run osmo-hlr_10.42.42.2(pid=25356): stdout: | (launched: 2022-12-14_01:43:00.594889) 01:43:03.909633 run osmo-hlr_10.42.42.2(pid=25356): stderr: | [0;m[1;31m20221214014300796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014300796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014300796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014300796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014300796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014300796 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014300809 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014300817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014300817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014300817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:43:03.978119 run osmo-msc_10.42.42.6(pid=25362): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25362)] 01:43:04.025280 run osmo-msc_10.42.42.6(pid=25362): stdout: | (launched: 2022-12-14_01:43:02.910716) 01:43:04.073902 run osmo-msc_10.42.42.6(pid=25362): stderr: | [0;m[38;5;43m20221214014303181 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014303181 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb13ede0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014303181 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014303182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014303182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014303182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014303184 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014303184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014303184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014303184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:43:04.122803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25355): Terminating (SIGTERM) 01:43:04.161757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25358): Terminating (SIGTERM) 01:43:04.200639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25361): Terminating (SIGTERM) 01:43:04.239737 --- ParallelTerminationStrategy: PID 25355 died... 01:43:04.258566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25355): Terminated: ok {rc=0} 01:43:04.301812 --- ParallelTerminationStrategy: PID 25358 died... 01:43:04.320005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25358): Terminated: ok {rc=0} 01:43:04.363284 --- ParallelTerminationStrategy: PID 25361 died... 01:43:04.381675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25361): Terminated: ok {rc=0} 01:43:04.464590 bus /sierra_3: Setting Powered False 01:43:05.561561 bus /sierra_3: Setting Powered False 01:43:06.679126 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:43:07.823509 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:43:07.835528 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:43:07.896633 tst mo_mt_call_osmux.py: using LAC 37675 01:43:08.019078 tst mo_mt_call_osmux.py: using RAC 190 01:43:08.137052 tst mo_mt_call_osmux.py: using CellId 37675 01:43:08.254160 tst mo_mt_call_osmux.py: using BVCI 37676 01:43:08.363120 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:43:08.374453 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:43:08.385633 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:43:08.396650 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:43:08.407970 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:43:08.419062 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:43:08.540639 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:43:08.657978 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:43:09.127506 run create_hlr_db(pid=25364): Launched 01:43:09.250413 bus /sierra_2: Setting Powered False 01:43:10.311072 run create_hlr_db(pid=25364): Terminated: ok {rc=0} 01:43:10.754095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25366): Launched 01:43:11.081058 run osmo-hlr_10.42.42.2(pid=25367): Launched 01:43:11.206324 run osmo-stp_10.42.42.5: Starting osmo-stp 01:43:11.768409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25369): Launched 01:43:12.093280 run osmo-stp_10.42.42.5(pid=25370): Launched 01:43:12.216104 run osmo-msc_10.42.42.6: Starting osmo-msc 01:43:12.806410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25372): Launched 01:43:13.132554 run osmo-msc_10.42.42.6(pid=25373): Launched 01:43:13.314192 run osmo-stp_10.42.42.5(pid=25370): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25370)] 01:43:13.450359 run osmo-stp_10.42.42.5(pid=25370): stdout: | (launched: 2022-12-14_01:43:12.033333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:13.587917 run osmo-stp_10.42.42.5(pid=25370): stderr: | [0;m[38;5;43m20221214014312226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014312226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014312227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014312227 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014312228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014312228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014312228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:13.723729 run osmo-stp_10.42.42.5(pid=25370): stdout: | (launched: 2022-12-14_01:43:12.033333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:13.852423 run osmo-stp_10.42.42.5(pid=25370): stderr: | [0;m[38;5;43m20221214014312226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014312226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014312227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014312227 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014312228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014312228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014312228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:14.006464 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25370): Process ended prematurely: osmo-stp_10.42.42.5(pid=25370) [trial-2397↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25370)] [trial-2397↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:43:14.016253 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 01:43:14.044295 run osmo-hlr_10.42.42.2(pid=25367): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25367)] 01:43:14.094482 run osmo-hlr_10.42.42.2(pid=25367): stdout: | (launched: 2022-12-14_01:43:11.021379) 01:43:14.146036 run osmo-hlr_10.42.42.2(pid=25367): stderr: | [0;m[1;31m20221214014311219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014311219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014311219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014311219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014311219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014311220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014311233 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014311241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014311241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014311241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:43:14.217894 run osmo-msc_10.42.42.6(pid=25373): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25373)] 01:43:14.267219 run osmo-msc_10.42.42.6(pid=25373): stdout: | (launched: 2022-12-14_01:43:13.072559) 01:43:14.318561 run osmo-msc_10.42.42.6(pid=25373): stderr: | [0;m[38;5;43m20221214014313393 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014313393 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f64d5e0ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014313393 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014313394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014313394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014313394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014313396 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014313396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014313396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014313396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:43:14.370323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25366): Terminating (SIGTERM) 01:43:14.411947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25369): Terminating (SIGTERM) 01:43:14.453526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25372): Terminating (SIGTERM) 01:43:14.495471 --- ParallelTerminationStrategy: PID 25366 died... 01:43:14.515888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25366): Terminated: ok {rc=0} 01:43:14.561992 --- ParallelTerminationStrategy: PID 25369 died... 01:43:14.581778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25369): Terminated: ok {rc=0} 01:43:14.627628 --- ParallelTerminationStrategy: PID 25372 died... 01:43:14.647369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25372): Terminated: ok {rc=0} 01:43:14.734439 bus /sierra_3: Setting Powered False 01:43:15.831762 bus /sierra_3: Setting Powered False 01:43:16.971645 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 emergency:nanobts+band-1900 --------------------------------------------------------------------- 01:43:18.227815 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:43:18.233744 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 01:43:18.258268 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 01:43:18.286757 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 01:43:18.374305 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 01:43:18.398906 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 01:43:18.426374 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 01:43:19.010263 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2397 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 01:43:19.016302 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:19.027731 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:43:19.068533 tst emergency_mo_mt_call.py: using LAC 37676 01:43:19.186400 tst emergency_mo_mt_call.py: using RAC 191 01:43:19.303938 tst emergency_mo_mt_call.py: using CellId 37676 01:43:19.420411 tst emergency_mo_mt_call.py: using BVCI 37677 01:43:19.529133 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:19.539775 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:19.550565 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:19.561229 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:19.571719 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:19.582232 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:19.696182 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:19.815688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:43:20.274700 run create_hlr_db(pid=25378): Launched 01:43:20.395088 bus /sierra_2: Setting Powered False 01:43:21.454302 run create_hlr_db(pid=25378): Terminated: ok {rc=0} 01:43:21.890014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25380): Launched 01:43:22.209581 run osmo-hlr_10.42.42.2(pid=25381): Launched 01:43:22.332552 run osmo-stp_10.42.42.5: Starting osmo-stp 01:43:22.883028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25383): Launched 01:43:23.202007 run osmo-stp_10.42.42.5(pid=25384): Launched 01:43:23.333763 tst emergency_mo_mt_call.py: using MSISDN 8434 01:43:23.499670 run osmo-msc_10.42.42.6: Starting osmo-msc 01:43:24.072715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25386): Launched 01:43:24.390793 run osmo-msc_10.42.42.6(pid=25387): Launched 01:43:24.568340 run osmo-stp_10.42.42.5(pid=25384): ERR: Terminated: ERROR {rc=1} [trial-2397↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25384)] 01:43:24.702128 run osmo-stp_10.42.42.5(pid=25384): stdout: | (launched: 2022-12-14_01:43:23.143076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:24.837255 run osmo-stp_10.42.42.5(pid=25384): stderr: | [0;m[38;5;43m20221214014323335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014323335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014323335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014323336 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014323336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014323336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014323336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:24.970563 run osmo-stp_10.42.42.5(pid=25384): stdout: | (launched: 2022-12-14_01:43:23.143076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:25.096847 run osmo-stp_10.42.42.5(pid=25384): stderr: | [0;m[38;5;43m20221214014323335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014323335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014323335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014323336 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014323336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014323336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014323336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:25.247804 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=25384): Process ended prematurely: osmo-stp_10.42.42.5(pid=25384) [trial-2397↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25384)] [trial-2397↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 01:43:25.257048 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 01:43:25.284296 run osmo-hlr_10.42.42.2(pid=25381): ERR: Terminated: ERROR {rc=237} [trial-2397↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25381)] 01:43:25.334258 run osmo-hlr_10.42.42.2(pid=25381): stdout: | (launched: 2022-12-14_01:43:22.150593) 01:43:25.385701 run osmo-hlr_10.42.42.2(pid=25381): stderr: | [0;m[1;31m20221214014322346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014322346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014322346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014322346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014322346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014322346 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014322359 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014322367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014322367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014322368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:43:25.457969 run osmo-msc_10.42.42.6(pid=25387): ERR: Terminated: ERROR {rc=2} [trial-2397↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25387)] 01:43:25.507308 run osmo-msc_10.42.42.6(pid=25387): stdout: | (launched: 2022-12-14_01:43:24.331847) 01:43:25.558786 run osmo-msc_10.42.42.6(pid=25387): stderr: | [0;m[38;5;43m20221214014324653 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014324653 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3a6eeb0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014324653 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014324653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014324653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014324653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014324655 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014324655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014324656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014324656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:43:25.610894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25380): Terminating (SIGTERM) 01:43:25.652331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25383): Terminating (SIGTERM) 01:43:25.693914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25386): Terminating (SIGTERM) 01:43:25.736175 --- ParallelTerminationStrategy: PID 25380 died... 01:43:25.756375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25380): Terminated: ok {rc=0} 01:43:25.802676 --- ParallelTerminationStrategy: PID 25383 died... 01:43:25.822452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25383): Terminated: ok {rc=0} 01:43:25.868205 --- ParallelTerminationStrategy: PID 25386 died... 01:43:25.887921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25386): Terminated: ok {rc=0} 01:43:25.975094 bus /sierra_3: Setting Powered False 01:43:27.073389 bus /sierra_3: Setting Powered False 01:43:28.188302 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 01:43:29.274413 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:29.286380 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:43:29.332527 tst emergency_preemptive_call.py: using LAC 37677 01:43:29.448703 tst emergency_preemptive_call.py: using RAC 192 01:43:29.563430 tst emergency_preemptive_call.py: using CellId 37677 01:43:29.677387 tst emergency_preemptive_call.py: using BVCI 37678 01:43:29.785595 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:29.796595 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:29.807361 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:29.817971 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:29.828529 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 01:43:29.839223 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:29.959607 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:30.075756 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:30.188856 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:30.306899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:43:30.769116 run create_hlr_db(pid=25389): Launched 01:43:30.898779 bus /sierra_2: Setting Powered False 01:43:31.961777 run create_hlr_db(pid=25389): Terminated: ok {rc=0} 01:43:32.415612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25391): Launched 01:43:32.736064 run osmo-hlr_10.42.42.2(pid=25392): Launched 01:43:32.858997 run osmo-stp_10.42.42.5: Starting osmo-stp 01:43:33.406208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25394): Launched 01:43:33.726465 run osmo-stp_10.42.42.5(pid=25395): Launched 01:43:33.859524 tst emergency_preemptive_call.py: using MSISDN 8435 01:43:34.024876 run osmo-msc_10.42.42.6: Starting osmo-msc 01:43:34.596301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25397): Launched 01:43:34.917459 run osmo-msc_10.42.42.6(pid=25398): Launched 01:43:35.097489 run osmo-stp_10.42.42.5(pid=25395): ERR: Terminated: ERROR {rc=1} [trial-2397↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25395)] 01:43:35.232593 run osmo-stp_10.42.42.5(pid=25395): stdout: | (launched: 2022-12-14_01:43:33.667485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:35.368443 run osmo-stp_10.42.42.5(pid=25395): stderr: | [0;m[38;5;43m20221214014333859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014333859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014333859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014333860 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014333860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014333860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014333860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:35.503217 run osmo-stp_10.42.42.5(pid=25395): stdout: | (launched: 2022-12-14_01:43:33.667485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:35.631180 run osmo-stp_10.42.42.5(pid=25395): stderr: | [0;m[38;5;43m20221214014333859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014333859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014333859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014333860 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014333860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014333860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014333860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:35.783780 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=25395): Process ended prematurely: osmo-stp_10.42.42.5(pid=25395) [trial-2397↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25395)] [trial-2397↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 01:43:35.792893 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 01:43:35.820685 run osmo-hlr_10.42.42.2(pid=25392): ERR: Terminated: ERROR {rc=237} [trial-2397↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25392)] 01:43:35.871056 run osmo-hlr_10.42.42.2(pid=25392): stdout: | (launched: 2022-12-14_01:43:32.677387) 01:43:35.922883 run osmo-hlr_10.42.42.2(pid=25392): stderr: | [0;m[1;31m20221214014332874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014332874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014332874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014332874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014332874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014332874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014332886 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014332895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014332895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014332895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:43:35.995298 run osmo-msc_10.42.42.6(pid=25398): ERR: Terminated: ERROR {rc=2} [trial-2397↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25398)] 01:43:36.045171 run osmo-msc_10.42.42.6(pid=25398): stdout: | (launched: 2022-12-14_01:43:34.858288) 01:43:36.096786 run osmo-msc_10.42.42.6(pid=25398): stderr: | [0;m[38;5;43m20221214014335177 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014335177 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2770cd5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014335177 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014335177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014335178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014335178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014335180 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014335180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014335180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014335180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:43:36.148687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25391): Terminating (SIGTERM) 01:43:36.190352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25394): Terminating (SIGTERM) 01:43:36.232270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25397): Terminating (SIGTERM) 01:43:36.274683 --- ParallelTerminationStrategy: PID 25391 died... 01:43:36.294993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25391): Terminated: ok {rc=0} 01:43:36.341498 --- ParallelTerminationStrategy: PID 25394 died... 01:43:36.361267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25394): Terminated: ok {rc=0} 01:43:36.407222 --- ParallelTerminationStrategy: PID 25397 died... 01:43:36.426969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25397): Terminated: ok {rc=0} 01:43:36.515108 bus /sierra_9: Setting Powered False 01:43:37.613872 bus /sierra_9: Setting Powered False 01:43:38.731440 bus /sierra_8: Setting Powered False 01:43:39.829465 bus /sierra_8: Setting Powered False 01:43:40.944687 bus /sierra_3: Setting Powered False 01:43:42.042099 bus /sierra_3: Setting Powered False 01:43:43.157610 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:nanobts+band-1900 --------------------------------------------------------------------- 01:43:44.432735 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:43:44.438544 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 01:43:44.463045 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 01:43:44.503030 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 01:43:44.594150 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 01:43:44.618838 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 01:43:44.658114 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 01:43:45.249935 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 01:43:45.303017 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:45.314268 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:43:45.353138 tst cs_paging_gprs_active.py: using LAC 37678 01:43:45.480030 tst cs_paging_gprs_active.py: using RAC 193 01:43:45.607345 tst cs_paging_gprs_active.py: using CellId 37678 01:43:45.741483 tst cs_paging_gprs_active.py: using BVCI 37679 01:43:45.875652 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:45.888029 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:45.900391 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:45.912606 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:45.926400 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:45.939476 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:45.952776 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:45.965351 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:45.978460 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:46.107128 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:46.261142 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:43:46.486072 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:43:46.817484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25403): Launched 01:43:47.113612 run iperf3-srv_10.42.42.10(pid=25404): Launched 01:43:47.232914 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:43:47.441397 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:43:47.747867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25405): Launched 01:43:48.013665 run iperf3-srv_10.42.42.10(pid=25406): Launched 01:43:48.129377 tst cs_paging_gprs_active.py:38: start network... 01:43:48.332851 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:43:48.803564 run create_hlr_db(pid=25407): Launched 01:43:48.927877 bus /sierra_2: Setting Powered False 01:43:49.989222 run create_hlr_db(pid=25407): Terminated: ok {rc=0} 01:43:50.410913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25409): Launched 01:43:50.715180 run osmo-hlr_10.42.42.2(pid=25410): Launched 01:43:50.830861 run osmo-stp_10.42.42.5: Starting osmo-stp 01:43:51.350826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25412): Launched 01:43:51.654122 run osmo-stp_10.42.42.5(pid=25413): Launched 01:43:51.769682 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:43:52.293075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25415): Launched 01:43:52.408579 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:43:52.664787 run patchelf(pid=25416): Launched 01:43:52.833897 run osmo-stp_10.42.42.5(pid=25413): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25413)] 01:43:52.961825 run osmo-stp_10.42.42.5(pid=25413): stdout: | (launched: 2022-12-14_01:43:51.597862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:53.091609 run osmo-stp_10.42.42.5(pid=25413): stderr: | [0;m[38;5;43m20221214014351770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014351770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014351770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014351771 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014351771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014351771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014351771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:53.222119 run osmo-stp_10.42.42.5(pid=25413): stdout: | (launched: 2022-12-14_01:43:51.597862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:43:53.345497 run osmo-stp_10.42.42.5(pid=25413): stderr: | [0;m[38;5;43m20221214014351770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014351770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014351770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014351771 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014351771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014351771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014351771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:43:53.491688 run patchelf(pid=25416): Terminating (SIGINT) 01:43:53.661182 run patchelf(pid=25416): Terminated: ok {rc=0} 01:43:53.783503 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25413): Process ended prematurely: osmo-stp_10.42.42.5(pid=25413) [trial-2397↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25413)] [trial-2397↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 01:43:53.793242 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 01:43:53.820322 run osmo-hlr_10.42.42.2(pid=25410): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25410)] 01:43:53.867033 run osmo-hlr_10.42.42.2(pid=25410): stdout: | (launched: 2022-12-14_01:43:50.658325) 01:43:53.915242 run osmo-hlr_10.42.42.2(pid=25410): stderr: | [0;m[1;31m20221214014350834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014350834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014350834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014350834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014350834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014350834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014350846 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014350857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014350857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014350857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:43:53.964296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25403): Terminating (SIGTERM) 01:43:54.003545 run iperf3-srv_10.42.42.10(pid=25404): Terminating (SIGTERM) 01:43:54.042649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25405): Terminating (SIGTERM) 01:43:54.081741 run iperf3-srv_10.42.42.10(pid=25406): Terminating (SIGTERM) 01:43:54.120755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25409): Terminating (SIGTERM) 01:43:54.159865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25412): Terminating (SIGTERM) 01:43:54.198750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25415): Terminating (SIGTERM) 01:43:54.238062 --- ParallelTerminationStrategy: PID 25403 died... 01:43:54.257192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25403): Terminated: ok {rc=0} 01:43:54.300843 --- ParallelTerminationStrategy: PID 25404 died... 01:43:54.319902 run iperf3-srv_10.42.42.10(pid=25404): Terminated {rc=256} 01:43:54.363114 --- ParallelTerminationStrategy: PID 25405 died... 01:43:54.381513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25405): Terminated: ok {rc=0} 01:43:54.424701 --- ParallelTerminationStrategy: PID 25406 died... 01:43:54.443196 run iperf3-srv_10.42.42.10(pid=25406): Terminated {rc=256} 01:43:54.486174 --- ParallelTerminationStrategy: PID 25409 died... 01:43:54.504761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25409): Terminated: ok {rc=0} 01:43:54.548083 --- ParallelTerminationStrategy: PID 25412 died... 01:43:54.566651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25412): Terminated: ok {rc=0} 01:43:54.610264 --- ParallelTerminationStrategy: PID 25415 died... 01:43:54.629135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25415): Terminated: ok {rc=0} 01:43:54.712862 bus /gobi_0: Setting Powered False 01:43:55.811370 bus /gobi_0: Setting Powered False 01:43:56.931547 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 01:43:58.078531 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:58.090059 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:43:58.129471 tst iperf3.py: using LAC 37679 01:43:58.262763 tst iperf3.py: using RAC 194 01:43:58.389733 tst iperf3.py: using CellId 37679 01:43:58.509016 tst iperf3.py: using BVCI 37680 01:43:58.618245 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:58.629258 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:58.639806 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:58.650592 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:58.661768 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:58.673346 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:58.684507 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:58.695597 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:43:58.706788 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:43:58.825533 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:43:59.028424 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:43:59.332871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25417): Launched 01:43:59.598782 run iperf3-srv_10.42.42.10(pid=25418): Launched 01:43:59.711850 tst iperf3.py:8: start network... 01:43:59.913861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:44:00.383298 run create_hlr_db(pid=25419): Launched 01:44:00.508174 bus /gobi_6: Setting Powered False 01:44:01.567799 run create_hlr_db(pid=25419): Terminated: ok {rc=0} 01:44:01.999098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25421): Launched 01:44:02.318718 run osmo-hlr_10.42.42.2(pid=25422): Launched 01:44:02.433686 run osmo-stp_10.42.42.5: Starting osmo-stp 01:44:02.956394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25424): Launched 01:44:03.258996 run osmo-stp_10.42.42.5(pid=25425): Launched 01:44:03.374129 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:44:03.893142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25427): Launched 01:44:04.011354 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:44:04.267263 run patchelf(pid=25428): Launched 01:44:04.436785 run osmo-stp_10.42.42.5(pid=25425): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25425)] 01:44:04.564225 run osmo-stp_10.42.42.5(pid=25425): stdout: | (launched: 2022-12-14_01:44:03.201744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:04.693788 run osmo-stp_10.42.42.5(pid=25425): stderr: | [0;m[38;5;43m20221214014403370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014403370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014403370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014403371 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014403371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014403371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014403371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:04.823523 run osmo-stp_10.42.42.5(pid=25425): stdout: | (launched: 2022-12-14_01:44:03.201744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:04.946526 run osmo-stp_10.42.42.5(pid=25425): stderr: | [0;m[38;5;43m20221214014403370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014403370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014403370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014403371 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014403371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014403371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014403371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:05.092023 run patchelf(pid=25428): Terminating (SIGINT) 01:44:05.261234 run patchelf(pid=25428): Terminated: ok {rc=0} 01:44:05.382888 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25425): Process ended prematurely: osmo-stp_10.42.42.5(pid=25425) [trial-2397↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25425)] [trial-2397↪gprs:nanobts+band-1900↪iperf3.py:8] 01:44:05.392328 tst iperf3.py:8: Test FAILED (7.4 sec) 01:44:05.419386 run osmo-hlr_10.42.42.2(pid=25422): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25422)] 01:44:05.466210 run osmo-hlr_10.42.42.2(pid=25422): stdout: | (launched: 2022-12-14_01:44:02.262149) 01:44:05.514993 run osmo-hlr_10.42.42.2(pid=25422): stderr: | [0;m[1;31m20221214014402435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014402435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014402435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014402435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014402436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014402436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014402448 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014402456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014402457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014402457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:44:05.564218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25417): Terminating (SIGTERM) 01:44:05.603791 run iperf3-srv_10.42.42.10(pid=25418): Terminating (SIGTERM) 01:44:05.642854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25421): Terminating (SIGTERM) 01:44:05.682224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25424): Terminating (SIGTERM) 01:44:05.721481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25427): Terminating (SIGTERM) 01:44:05.761271 --- ParallelTerminationStrategy: PID 25417 died... 01:44:05.780435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25417): Terminated: ok {rc=0} 01:44:05.824630 --- ParallelTerminationStrategy: PID 25418 died... 01:44:05.843175 run iperf3-srv_10.42.42.10(pid=25418): Terminated {rc=256} 01:44:05.886446 --- ParallelTerminationStrategy: PID 25421 died... 01:44:05.904744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25421): Terminated: ok {rc=0} 01:44:05.948076 --- ParallelTerminationStrategy: PID 25424 died... 01:44:05.966682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25424): Terminated: ok {rc=0} 01:44:06.009838 --- ParallelTerminationStrategy: PID 25427 died... 01:44:06.028203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25427): Terminated: ok {rc=0} 01:44:06.111486 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 01:44:07.260916 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:07.272923 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:44:07.313620 tst iperf3m4.py: using LAC 37680 01:44:07.439884 tst iperf3m4.py: using RAC 195 01:44:07.567429 tst iperf3m4.py: using CellId 37680 01:44:07.696472 tst iperf3m4.py: using BVCI 37681 01:44:07.814597 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:07.825923 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:07.836830 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:07.848039 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:07.859536 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:07.870840 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:07.882304 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:07.893495 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:07.904791 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:44:08.022920 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:44:08.144259 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:44:08.260766 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:44:08.380085 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:44:08.599894 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:08.929755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25429): Launched 01:44:09.215589 run iperf3-srv_10.42.42.10(pid=25430): Launched 01:44:09.337985 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:44:09.556186 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:09.883977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25431): Launched 01:44:10.168417 run iperf3-srv_10.42.42.10(pid=25432): Launched 01:44:10.291260 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:44:10.509203 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:10.836633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25433): Launched 01:44:11.120007 run iperf3-srv_10.42.42.10(pid=25434): Launched 01:44:11.242982 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:44:11.461719 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:11.788493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25435): Launched 01:44:12.074917 run iperf3-srv_10.42.42.10(pid=25436): Launched 01:44:12.198697 tst iperf3m4.py:8: start network... 01:44:12.417354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:44:12.922749 run create_hlr_db(pid=25437): Launched 01:44:13.048065 bus /gobi_6: Setting Powered False 01:44:14.111407 run create_hlr_db(pid=25437): Terminated: ok {rc=0} 01:44:14.562890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25439): Launched 01:44:14.889764 run osmo-hlr_10.42.42.2(pid=25440): Launched 01:44:15.013940 run osmo-stp_10.42.42.5: Starting osmo-stp 01:44:15.577011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25442): Launched 01:44:15.914152 run osmo-stp_10.42.42.5(pid=25443): Launched 01:44:16.113143 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:44:16.847134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25445): Launched 01:44:16.984057 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:44:17.265982 run patchelf(pid=25446): Launched 01:44:17.462208 run osmo-stp_10.42.42.5(pid=25443): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25443)] 01:44:17.600041 run osmo-stp_10.42.42.5(pid=25443): stdout: | (launched: 2022-12-14_01:44:15.843920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:17.739849 run osmo-stp_10.42.42.5(pid=25443): stderr: | [0;m[38;5;43m20221214014416175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014416175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014416176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014416179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014416180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014416180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014416180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:17.879931 run osmo-stp_10.42.42.5(pid=25443): stdout: | (launched: 2022-12-14_01:44:15.843920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:18.012706 run osmo-stp_10.42.42.5(pid=25443): stderr: | [0;m[38;5;43m20221214014416175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014416175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014416176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014416179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014416180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014416180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014416180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:18.169993 run patchelf(pid=25446): Terminating (SIGINT) 01:44:18.352241 run patchelf(pid=25446): Terminated: ok {rc=0} 01:44:18.484119 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25443): Process ended prematurely: osmo-stp_10.42.42.5(pid=25443) [trial-2397↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25443)] [trial-2397↪gprs:nanobts+band-1900↪iperf3m4.py:8] 01:44:18.494543 tst iperf3m4.py:8: Test FAILED (11.3 sec) 01:44:18.523406 run osmo-hlr_10.42.42.2(pid=25440): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25440)] 01:44:18.573916 run osmo-hlr_10.42.42.2(pid=25440): stdout: | (launched: 2022-12-14_01:44:14.828920) 01:44:18.626229 run osmo-hlr_10.42.42.2(pid=25440): stderr: | [0;m[1;31m20221214014415028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014415028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014415028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014415028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014415028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014415028 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014415040 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014415048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014415048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014415048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:44:18.678509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25429): Terminating (SIGTERM) 01:44:18.720361 run iperf3-srv_10.42.42.10(pid=25430): Terminating (SIGTERM) 01:44:18.762491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25431): Terminating (SIGTERM) 01:44:18.805007 run iperf3-srv_10.42.42.10(pid=25432): Terminating (SIGTERM) 01:44:18.846810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25433): Terminating (SIGTERM) 01:44:18.889229 run iperf3-srv_10.42.42.10(pid=25434): Terminating (SIGTERM) 01:44:18.931220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25435): Terminating (SIGTERM) 01:44:18.973434 run iperf3-srv_10.42.42.10(pid=25436): Terminating (SIGTERM) 01:44:19.015358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25439): Terminating (SIGTERM) 01:44:19.057533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25442): Terminating (SIGTERM) 01:44:19.099605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25445): Terminating (SIGTERM) 01:44:19.142396 --- ParallelTerminationStrategy: PID 25429 died... 01:44:19.163117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25429): Terminated: ok {rc=0} 01:44:19.210064 --- ParallelTerminationStrategy: PID 25430 died... 01:44:19.230259 run iperf3-srv_10.42.42.10(pid=25430): Terminated {rc=256} 01:44:19.276803 --- ParallelTerminationStrategy: PID 25431 died... 01:44:19.297427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25431): Terminated: ok {rc=0} 01:44:19.344180 --- ParallelTerminationStrategy: PID 25432 died... 01:44:19.364153 run iperf3-srv_10.42.42.10(pid=25432): Terminated {rc=256} 01:44:19.410930 --- ParallelTerminationStrategy: PID 25433 died... 01:44:19.431032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25433): Terminated: ok {rc=0} 01:44:19.477648 --- ParallelTerminationStrategy: PID 25434 died... 01:44:19.497898 run iperf3-srv_10.42.42.10(pid=25434): Terminated {rc=256} 01:44:19.544494 --- ParallelTerminationStrategy: PID 25435 died... 01:44:19.564731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25435): Terminated: ok {rc=0} 01:44:19.611230 --- ParallelTerminationStrategy: PID 25436 died... 01:44:19.631404 run iperf3-srv_10.42.42.10(pid=25436): Terminated {rc=256} 01:44:19.678001 --- ParallelTerminationStrategy: PID 25439 died... 01:44:19.697992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25439): Terminated: ok {rc=0} 01:44:19.744383 --- ParallelTerminationStrategy: PID 25442 died... 01:44:19.764459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25442): Terminated: ok {rc=0} 01:44:19.811164 --- ParallelTerminationStrategy: PID 25445 died... 01:44:19.831250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25445): Terminated: ok {rc=0} 01:44:19.919879 bus /gobi_4: Setting Powered False 01:44:21.019337 bus /gobi_4: Setting Powered False 01:44:22.135085 bus /gobi_1: Setting Powered False 01:44:23.231893 bus /gobi_1: Setting Powered False 01:44:24.346639 bus /gobi_0: Setting Powered False 01:44:25.445719 bus /gobi_0: Setting Powered False 01:44:26.561458 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 01:44:27.663740 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:27.675366 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:44:27.714990 tst ping.py: using LAC 37681 01:44:27.841032 tst ping.py: using RAC 196 01:44:27.965337 tst ping.py: using CellId 37681 01:44:28.090837 tst ping.py: using BVCI 37682 01:44:28.206178 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:28.217619 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:28.228911 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:28.240036 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:28.251370 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:28.262758 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:28.274252 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:28.285694 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:44:28.404394 tst ping.py:19: start network... 01:44:28.619531 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:44:29.114593 run create_hlr_db(pid=25447): Launched 01:44:29.235863 bus /gobi_6: Setting Powered False 01:44:30.299614 run create_hlr_db(pid=25447): Terminated: ok {rc=0} 01:44:30.745053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25449): Launched 01:44:31.074356 run osmo-hlr_10.42.42.2(pid=25450): Launched 01:44:31.212267 run osmo-stp_10.42.42.5: Starting osmo-stp 01:44:31.871270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25452): Launched 01:44:32.241005 run osmo-stp_10.42.42.5(pid=25453): Launched 01:44:32.388456 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:44:32.962492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25455): Launched 01:44:33.087543 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:44:33.358887 run patchelf(pid=25456): Launched 01:44:33.538289 run osmo-stp_10.42.42.5(pid=25453): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25453)] 01:44:33.674024 run osmo-stp_10.42.42.5(pid=25453): stdout: | (launched: 2022-12-14_01:44:32.180643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:33.811564 run osmo-stp_10.42.42.5(pid=25453): stderr: | [0;m[38;5;43m20221214014432533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014432533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014432533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014432534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014432534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014432534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014432534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:33.949304 run osmo-stp_10.42.42.5(pid=25453): stdout: | (launched: 2022-12-14_01:44:32.180643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:34.080415 run osmo-stp_10.42.42.5(pid=25453): stderr: | [0;m[38;5;43m20221214014432533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014432533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014432533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014432534 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014432534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014432534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014432534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:34.235554 run patchelf(pid=25456): Terminating (SIGINT) 01:44:34.415138 run patchelf(pid=25456): Terminated: ok {rc=0} 01:44:34.544298 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25453): Process ended prematurely: osmo-stp_10.42.42.5(pid=25453) [trial-2397↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25453)] [trial-2397↪gprs:nanobts+band-1900↪ping.py:22] 01:44:34.554296 tst ping.py:22: Test FAILED (6.9 sec) 01:44:34.582405 run osmo-hlr_10.42.42.2(pid=25450): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25450)] 01:44:34.634940 run osmo-hlr_10.42.42.2(pid=25450): stdout: | (launched: 2022-12-14_01:44:31.015380) 01:44:34.687612 run osmo-hlr_10.42.42.2(pid=25450): stderr: | [0;m[1;31m20221214014431419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014431419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014431419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014431419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014431419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014431419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014431448 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014431464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014431464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014431464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:44:34.740375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25449): Terminating (SIGTERM) 01:44:34.782406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25452): Terminating (SIGTERM) 01:44:34.825514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25455): Terminating (SIGTERM) 01:44:34.868509 --- ParallelTerminationStrategy: PID 25449 died... 01:44:34.889626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25449): Terminated: ok {rc=0} 01:44:34.937225 --- ParallelTerminationStrategy: PID 25452 died... 01:44:34.957785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25452): Terminated: ok {rc=0} 01:44:35.004660 --- ParallelTerminationStrategy: PID 25455 died... 01:44:35.025236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25455): Terminated: ok {rc=0} 01:44:35.114870 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 01:44:36.202418 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:36.214565 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 01:44:36.255396 tst ping_idle_ping.py: using LAC 37682 01:44:36.382225 tst ping_idle_ping.py: using RAC 197 01:44:36.506855 tst ping_idle_ping.py: using CellId 37682 01:44:36.631223 tst ping_idle_ping.py: using BVCI 37683 01:44:36.747096 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:36.758561 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:36.769733 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:36.780754 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:36.792097 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:36.803384 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:36.815298 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 01:44:36.826883 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 01:44:36.943596 tst ping_idle_ping.py:24: start network... 01:44:37.143675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:44:37.609385 run create_hlr_db(pid=25458): Launched 01:44:37.732747 bus /gobi_6: Setting Powered False 01:44:38.793165 run create_hlr_db(pid=25458): Terminated: ok {rc=0} 01:44:39.212284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25460): Launched 01:44:39.512606 run osmo-hlr_10.42.42.2(pid=25461): Launched 01:44:39.625886 run osmo-stp_10.42.42.5: Starting osmo-stp 01:44:40.141482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25463): Launched 01:44:40.442284 run osmo-stp_10.42.42.5(pid=25464): Launched 01:44:40.557372 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:44:41.071811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25466): Launched 01:44:41.187260 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:44:41.439215 run patchelf(pid=25467): Launched 01:44:41.607615 run osmo-stp_10.42.42.5(pid=25464): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25464)] 01:44:41.733896 run osmo-stp_10.42.42.5(pid=25464): stdout: | (launched: 2022-12-14_01:44:40.385884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:41.862458 run osmo-stp_10.42.42.5(pid=25464): stderr: | [0;m[38;5;43m20221214014440555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014440555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014440556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014440556 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014440556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014440557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014440557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:41.990858 run osmo-stp_10.42.42.5(pid=25464): stdout: | (launched: 2022-12-14_01:44:40.385884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:42.112489 run osmo-stp_10.42.42.5(pid=25464): stderr: | [0;m[38;5;43m20221214014440555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014440555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014440556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014440556 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014440556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014440557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014440557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:42.256839 run patchelf(pid=25467): Terminating (SIGINT) 01:44:42.423474 run patchelf(pid=25467): Terminated: ok {rc=0} 01:44:42.543708 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25464): Process ended prematurely: osmo-stp_10.42.42.5(pid=25464) [trial-2397↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25464)] [trial-2397↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 01:44:42.552701 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 01:44:42.579541 run osmo-hlr_10.42.42.2(pid=25461): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25461)] 01:44:42.627055 run osmo-hlr_10.42.42.2(pid=25461): stdout: | (launched: 2022-12-14_01:44:39.456498) 01:44:42.675708 run osmo-hlr_10.42.42.2(pid=25461): stderr: | [0;m[1;31m20221214014439652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014439652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014439652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014439652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014439652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014439652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014439664 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014439672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014439672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014439672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:44:42.724904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25460): Terminating (SIGTERM) 01:44:42.764498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25463): Terminating (SIGTERM) 01:44:42.804220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25466): Terminating (SIGTERM) 01:44:42.844168 --- ParallelTerminationStrategy: PID 25460 died... 01:44:42.863541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25460): Terminated: ok {rc=0} 01:44:42.907442 --- ParallelTerminationStrategy: PID 25463 died... 01:44:42.926294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25463): Terminated: ok {rc=0} 01:44:42.969879 --- ParallelTerminationStrategy: PID 25466 died... 01:44:42.988846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25466): Terminated: ok {rc=0} 01:44:43.072371 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 01:44:44.368520 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:44:44.375073 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:44:44.398578 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:44:44.436588 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:44:44.522569 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:44:44.546416 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:44:44.584159 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:44:45.179950 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:44:45.228175 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:45.239123 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:44:45.279108 tst cs_paging_gprs_active.py: using LAC 37683 01:44:45.398800 tst cs_paging_gprs_active.py: using RAC 198 01:44:45.518403 tst cs_paging_gprs_active.py: using CellId 37683 01:44:45.639754 tst cs_paging_gprs_active.py: using BVCI 37684 01:44:45.750832 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:45.761889 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:45.772589 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:45.783318 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:45.793974 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:45.804687 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:45.815584 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:45.826211 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:45.844113 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:44:45.982075 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:44:46.099119 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:44:46.327752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:46.669762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25471): Launched 01:44:46.946907 run iperf3-srv_10.42.42.10(pid=25472): Launched 01:44:47.099616 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:44:47.326454 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:47.655004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25473): Launched 01:44:47.942525 run iperf3-srv_10.42.42.10(pid=25474): Launched 01:44:48.066702 tst cs_paging_gprs_active.py:38: start network... 01:44:48.286007 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:44:48.788578 run create_hlr_db(pid=25475): Launched 01:44:48.914778 bus /gobi_6: Setting Powered False 01:44:49.978655 run create_hlr_db(pid=25475): Terminated: ok {rc=0} 01:44:50.412211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25477): Launched 01:44:50.739864 run osmo-hlr_10.42.42.2(pid=25478): Launched 01:44:50.864243 run osmo-stp_10.42.42.5: Starting osmo-stp 01:44:51.426401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25480): Launched 01:44:51.752929 run osmo-stp_10.42.42.5(pid=25481): Launched 01:44:51.877698 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:44:52.439441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25483): Launched 01:44:52.563750 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:44:52.839699 run patchelf(pid=25484): Launched 01:44:53.020227 run osmo-stp_10.42.42.5(pid=25481): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25481)] 01:44:53.158161 run osmo-stp_10.42.42.5(pid=25481): stdout: | (launched: 2022-12-14_01:44:51.692774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:53.297344 run osmo-stp_10.42.42.5(pid=25481): stderr: | [0;m[38;5;43m20221214014451881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014451881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014451882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014451882 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014451882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014451882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014451883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:53.436617 run osmo-stp_10.42.42.5(pid=25481): stdout: | (launched: 2022-12-14_01:44:51.692774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:44:53.569944 run osmo-stp_10.42.42.5(pid=25481): stderr: | [0;m[38;5;43m20221214014451881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014451881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014451882 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014451882 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014451882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014451882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014451883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:44:53.727791 run patchelf(pid=25484): Terminating (SIGINT) 01:44:53.910719 run patchelf(pid=25484): Terminated: ok {rc=0} 01:44:54.041606 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25481): Process ended prematurely: osmo-stp_10.42.42.5(pid=25481) [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25481)] [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:44:54.051960 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 01:44:54.080541 run osmo-hlr_10.42.42.2(pid=25478): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25478)] 01:44:54.130888 run osmo-hlr_10.42.42.2(pid=25478): stdout: | (launched: 2022-12-14_01:44:50.679535) 01:44:54.182162 run osmo-hlr_10.42.42.2(pid=25478): stderr: | [0;m[1;31m20221214014450876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014450876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014450876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014450876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014450876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014450876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014450890 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014450898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014450898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014450898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:44:54.234520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25471): Terminating (SIGTERM) 01:44:54.275872 run iperf3-srv_10.42.42.10(pid=25472): Terminating (SIGTERM) 01:44:54.317386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25473): Terminating (SIGTERM) 01:44:54.359262 run iperf3-srv_10.42.42.10(pid=25474): Terminating (SIGTERM) 01:44:54.401803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25477): Terminating (SIGTERM) 01:44:54.443166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25480): Terminating (SIGTERM) 01:44:54.484822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25483): Terminating (SIGTERM) 01:44:54.526603 --- ParallelTerminationStrategy: PID 25471 died... 01:44:54.546612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25471): Terminated: ok {rc=0} 01:44:54.592658 --- ParallelTerminationStrategy: PID 25472 died... 01:44:54.612137 run iperf3-srv_10.42.42.10(pid=25472): Terminated {rc=256} 01:44:54.657946 --- ParallelTerminationStrategy: PID 25473 died... 01:44:54.677544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25473): Terminated: ok {rc=0} 01:44:54.723007 --- ParallelTerminationStrategy: PID 25474 died... 01:44:54.742564 run iperf3-srv_10.42.42.10(pid=25474): Terminated {rc=256} 01:44:54.788073 --- ParallelTerminationStrategy: PID 25477 died... 01:44:54.807623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25477): Terminated: ok {rc=0} 01:44:54.853515 --- ParallelTerminationStrategy: PID 25480 died... 01:44:54.873313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25480): Terminated: ok {rc=0} 01:44:54.918867 --- ParallelTerminationStrategy: PID 25483 died... 01:44:54.938562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25483): Terminated: ok {rc=0} 01:44:55.026079 bus /gobi_0: Setting Powered False 01:44:56.122770 bus /gobi_0: Setting Powered False 01:44:57.237118 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:44:58.385548 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:58.397670 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:44:58.442576 tst iperf3.py: using LAC 37684 01:44:58.564042 tst iperf3.py: using RAC 199 01:44:58.684643 tst iperf3.py: using CellId 37684 01:44:58.803973 tst iperf3.py: using BVCI 37685 01:44:58.915390 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:58.926648 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:58.937903 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:58.948846 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:58.960360 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:58.971855 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:58.983444 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:58.994907 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:44:59.006553 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:44:59.125985 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:44:59.346084 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:44:59.674399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25486): Launched 01:44:59.960737 run iperf3-srv_10.42.42.10(pid=25487): Launched 01:45:00.084837 tst iperf3.py:8: start network... 01:45:00.304593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:45:00.808337 run create_hlr_db(pid=25488): Launched 01:45:00.948124 bus /gobi_6: Setting Powered False 01:45:02.008692 run create_hlr_db(pid=25488): Terminated: ok {rc=0} 01:45:02.444157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25493): Launched 01:45:02.748537 run osmo-hlr_10.42.42.2(pid=25494): Launched 01:45:02.864150 run osmo-stp_10.42.42.5: Starting osmo-stp 01:45:03.390334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25496): Launched 01:45:03.695313 run osmo-stp_10.42.42.5(pid=25497): Launched 01:45:03.810415 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:45:04.331991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25499): Launched 01:45:04.448296 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:45:04.704294 run patchelf(pid=25500): Launched 01:45:04.872693 run osmo-stp_10.42.42.5(pid=25497): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25497)] 01:45:05.000505 run osmo-stp_10.42.42.5(pid=25497): stdout: | (launched: 2022-12-14_01:45:03.638323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:05.131310 run osmo-stp_10.42.42.5(pid=25497): stderr: | [0;m[38;5;43m20221214014503809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014503809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014503809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014503810 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014503810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014503810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014503810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:05.261516 run osmo-stp_10.42.42.5(pid=25497): stdout: | (launched: 2022-12-14_01:45:03.638323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:05.384677 run osmo-stp_10.42.42.5(pid=25497): stderr: | [0;m[38;5;43m20221214014503809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014503809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014503809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014503810 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014503810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014503810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014503810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:05.530690 run patchelf(pid=25500): Terminating (SIGINT) 01:45:05.699732 run patchelf(pid=25500): Terminated: ok {rc=0} 01:45:05.822966 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25497): Process ended prematurely: osmo-stp_10.42.42.5(pid=25497) [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25497)] [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 01:45:05.832418 tst iperf3.py:8: Test FAILED (7.5 sec) 01:45:05.859470 run osmo-hlr_10.42.42.2(pid=25494): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25494)] 01:45:05.906461 run osmo-hlr_10.42.42.2(pid=25494): stdout: | (launched: 2022-12-14_01:45:02.692046) 01:45:05.955169 run osmo-hlr_10.42.42.2(pid=25494): stderr: | [0;m[1;31m20221214014502866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014502866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014502866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014502866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014502866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014502867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014502880 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014502889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014502889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014502889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:45:06.005209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25486): Terminating (SIGTERM) 01:45:06.044497 run iperf3-srv_10.42.42.10(pid=25487): Terminating (SIGTERM) 01:45:06.083790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25493): Terminating (SIGTERM) 01:45:06.123214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25496): Terminating (SIGTERM) 01:45:06.162245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25499): Terminating (SIGTERM) 01:45:06.201852 --- ParallelTerminationStrategy: PID 25486 died... 01:45:06.220821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25486): Terminated: ok {rc=0} 01:45:06.264733 --- ParallelTerminationStrategy: PID 25487 died... 01:45:06.283410 run iperf3-srv_10.42.42.10(pid=25487): Terminated {rc=256} 01:45:06.326814 --- ParallelTerminationStrategy: PID 25493 died... 01:45:06.345425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25493): Terminated: ok {rc=0} 01:45:06.388751 --- ParallelTerminationStrategy: PID 25496 died... 01:45:06.407411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25496): Terminated: ok {rc=0} 01:45:06.450683 --- ParallelTerminationStrategy: PID 25499 died... 01:45:06.469329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25499): Terminated: ok {rc=0} 01:45:06.555045 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:45:07.700703 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:07.712494 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:45:07.758117 tst iperf3m4.py: using LAC 37685 01:45:07.875962 tst iperf3m4.py: using RAC 200 01:45:07.992913 tst iperf3m4.py: using CellId 37685 01:45:08.109966 tst iperf3m4.py: using BVCI 37686 01:45:08.219040 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:08.230222 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:08.241116 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:08.251861 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:08.262618 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:08.273302 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:08.284238 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:08.294886 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:08.305858 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:45:08.423427 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:45:08.547937 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:45:08.665879 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:45:08.783361 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:45:08.987357 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:09.293651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25501): Launched 01:45:09.560753 run iperf3-srv_10.42.42.10(pid=25502): Launched 01:45:09.675226 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:45:09.879741 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:10.185809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25503): Launched 01:45:10.453012 run iperf3-srv_10.42.42.10(pid=25504): Launched 01:45:10.566890 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:45:10.769883 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:11.075905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25505): Launched 01:45:11.342052 run iperf3-srv_10.42.42.10(pid=25506): Launched 01:45:11.458295 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:45:11.661720 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:11.968897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25507): Launched 01:45:12.236163 run iperf3-srv_10.42.42.10(pid=25508): Launched 01:45:12.351271 tst iperf3m4.py:8: start network... 01:45:12.553733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:45:13.023416 run create_hlr_db(pid=25509): Launched 01:45:13.149434 bus /gobi_6: Setting Powered False 01:45:14.210223 run create_hlr_db(pid=25509): Terminated: ok {rc=0} 01:45:14.657109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25511): Launched 01:45:14.985739 run osmo-hlr_10.42.42.2(pid=25512): Launched 01:45:15.111401 run osmo-stp_10.42.42.5: Starting osmo-stp 01:45:15.674470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25514): Launched 01:45:16.021783 run osmo-stp_10.42.42.5(pid=25515): Launched 01:45:16.215076 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:45:16.848320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25517): Launched 01:45:17.018716 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:45:17.308744 run patchelf(pid=25518): Launched 01:45:17.495257 run osmo-stp_10.42.42.5(pid=25515): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25515)] 01:45:17.623542 run osmo-stp_10.42.42.5(pid=25515): stdout: | (launched: 2022-12-14_01:45:15.959448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:17.754223 run osmo-stp_10.42.42.5(pid=25515): stderr: | [0;m[38;5;43m20221214014516280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014516280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014516281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014516281 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014516281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014516282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014516282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:17.885509 run osmo-stp_10.42.42.5(pid=25515): stdout: | (launched: 2022-12-14_01:45:15.959448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:18.009565 run osmo-stp_10.42.42.5(pid=25515): stderr: | [0;m[38;5;43m20221214014516280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014516280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014516281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014516281 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014516281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014516282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014516282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:18.156458 run patchelf(pid=25518): Terminating (SIGINT) 01:45:18.326630 run patchelf(pid=25518): Terminated: ok {rc=0} 01:45:18.449403 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25515): Process ended prematurely: osmo-stp_10.42.42.5(pid=25515) [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25515)] [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 01:45:18.458932 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:45:18.486377 run osmo-hlr_10.42.42.2(pid=25512): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25512)] 01:45:18.533967 run osmo-hlr_10.42.42.2(pid=25512): stdout: | (launched: 2022-12-14_01:45:14.925431) 01:45:18.583331 run osmo-hlr_10.42.42.2(pid=25512): stderr: | [0;m[1;31m20221214014515121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014515121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014515123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014515123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014515123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014515123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014515138 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014515146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014515146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014515146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:45:18.633347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25501): Terminating (SIGTERM) 01:45:18.673322 run iperf3-srv_10.42.42.10(pid=25502): Terminating (SIGTERM) 01:45:18.712878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25503): Terminating (SIGTERM) 01:45:18.752491 run iperf3-srv_10.42.42.10(pid=25504): Terminating (SIGTERM) 01:45:18.791995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25505): Terminating (SIGTERM) 01:45:18.831706 run iperf3-srv_10.42.42.10(pid=25506): Terminating (SIGTERM) 01:45:18.871103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25507): Terminating (SIGTERM) 01:45:18.910497 run iperf3-srv_10.42.42.10(pid=25508): Terminating (SIGTERM) 01:45:18.949819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25511): Terminating (SIGTERM) 01:45:18.989430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25514): Terminating (SIGTERM) 01:45:19.028776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25517): Terminating (SIGTERM) 01:45:19.068691 --- ParallelTerminationStrategy: PID 25501 died... 01:45:19.088245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25501): Terminated: ok {rc=0} 01:45:19.132381 --- ParallelTerminationStrategy: PID 25502 died... 01:45:19.151313 run iperf3-srv_10.42.42.10(pid=25502): Terminated {rc=256} 01:45:19.195244 --- ParallelTerminationStrategy: PID 25503 died... 01:45:19.214299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25503): Terminated: ok {rc=0} 01:45:19.258314 --- ParallelTerminationStrategy: PID 25504 died... 01:45:19.277240 run iperf3-srv_10.42.42.10(pid=25504): Terminated {rc=256} 01:45:19.320932 --- ParallelTerminationStrategy: PID 25505 died... 01:45:19.339651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25505): Terminated: ok {rc=0} 01:45:19.383177 --- ParallelTerminationStrategy: PID 25506 died... 01:45:19.401868 run iperf3-srv_10.42.42.10(pid=25506): Terminated {rc=256} 01:45:19.445392 --- ParallelTerminationStrategy: PID 25507 died... 01:45:19.463920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25507): Terminated: ok {rc=0} 01:45:19.507642 --- ParallelTerminationStrategy: PID 25508 died... 01:45:19.526425 run iperf3-srv_10.42.42.10(pid=25508): Terminated {rc=256} 01:45:19.569842 --- ParallelTerminationStrategy: PID 25511 died... 01:45:19.588484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25511): Terminated: ok {rc=0} 01:45:19.631742 --- ParallelTerminationStrategy: PID 25514 died... 01:45:19.650467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25514): Terminated: ok {rc=0} 01:45:19.694038 --- ParallelTerminationStrategy: PID 25517 died... 01:45:19.712933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25517): Terminated: ok {rc=0} 01:45:19.799047 bus /gobi_4: Setting Powered False 01:45:20.900681 bus /gobi_4: Setting Powered False 01:45:22.015666 bus /gobi_1: Setting Powered False 01:45:23.114138 bus /gobi_1: Setting Powered False 01:45:24.230419 bus /gobi_0: Setting Powered False 01:45:25.328692 bus /gobi_0: Setting Powered False 01:45:26.445758 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 01:45:27.547004 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:27.559251 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:45:27.601565 tst ping.py: using LAC 37686 01:45:27.726361 tst ping.py: using RAC 201 01:45:27.852260 tst ping.py: using CellId 37686 01:45:27.979925 tst ping.py: using BVCI 37687 01:45:28.096529 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:28.108057 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:28.119507 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:28.130816 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:28.142421 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:28.153935 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:28.165726 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:28.177303 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:45:28.294210 tst ping.py:19: start network... 01:45:28.492257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:45:28.950753 run create_hlr_db(pid=25519): Launched 01:45:29.074055 bus /gobi_6: Setting Powered False 01:45:30.133129 run create_hlr_db(pid=25519): Terminated: ok {rc=0} 01:45:30.547738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25521): Launched 01:45:30.849723 run osmo-hlr_10.42.42.2(pid=25522): Launched 01:45:31.079915 run osmo-stp_10.42.42.5: Starting osmo-stp 01:45:31.758032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25524): Launched 01:45:32.098073 run osmo-stp_10.42.42.5(pid=25525): Launched 01:45:32.345199 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:45:32.872669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25527): Launched 01:45:32.986008 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:45:33.236755 run patchelf(pid=25528): Launched 01:45:33.402743 run osmo-stp_10.42.42.5(pid=25525): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25525)] 01:45:33.528001 run osmo-stp_10.42.42.5(pid=25525): stdout: | (launched: 2022-12-14_01:45:32.038318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:33.655247 run osmo-stp_10.42.42.5(pid=25525): stderr: | [0;m[38;5;43m20221214014532333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014532333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014532334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014532334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014532334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014532335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014532335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:33.783294 run osmo-stp_10.42.42.5(pid=25525): stdout: | (launched: 2022-12-14_01:45:32.038318) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:33.903979 run osmo-stp_10.42.42.5(pid=25525): stderr: | [0;m[38;5;43m20221214014532333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014532333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014532334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014532334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014532334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014532335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014532335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:34.048707 run patchelf(pid=25528): Terminating (SIGINT) 01:45:34.214397 run patchelf(pid=25528): Terminated: ok {rc=0} 01:45:34.333431 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25525): Process ended prematurely: osmo-stp_10.42.42.5(pid=25525) [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25525)] [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 01:45:34.342301 tst ping.py:22: Test FAILED (6.8 sec) 01:45:34.368865 run osmo-hlr_10.42.42.2(pid=25522): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25522)] 01:45:34.416387 run osmo-hlr_10.42.42.2(pid=25522): stdout: | (launched: 2022-12-14_01:45:30.790622) 01:45:34.465336 run osmo-hlr_10.42.42.2(pid=25522): stderr: | [0;m[1;31m20221214014531134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014531134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014531134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014531134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014531135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014531135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014531160 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014531186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014531186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014531186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:45:34.514699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25521): Terminating (SIGTERM) 01:45:34.553924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25524): Terminating (SIGTERM) 01:45:34.593050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25527): Terminating (SIGTERM) 01:45:34.632430 --- ParallelTerminationStrategy: PID 25521 died... 01:45:34.651751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25521): Terminated: ok {rc=0} 01:45:34.695622 --- ParallelTerminationStrategy: PID 25524 died... 01:45:34.714540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25524): Terminated: ok {rc=0} 01:45:34.757961 --- ParallelTerminationStrategy: PID 25527 died... 01:45:34.776689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25527): Terminated: ok {rc=0} 01:45:34.862432 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:45:35.949184 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:35.961121 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:45:36.003581 tst ping_idle_ping.py: using LAC 37687 01:45:36.122436 tst ping_idle_ping.py: using RAC 202 01:45:36.240868 tst ping_idle_ping.py: using CellId 37687 01:45:36.361064 tst ping_idle_ping.py: using BVCI 37688 01:45:36.470391 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:36.481563 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:36.492295 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:36.503018 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:36.513947 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:36.524854 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:36.536407 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:45:36.547526 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:45:36.666417 tst ping_idle_ping.py:24: start network... 01:45:36.881868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:45:37.383407 run create_hlr_db(pid=25529): Launched 01:45:37.505624 bus /gobi_6: Setting Powered False 01:45:38.569090 run create_hlr_db(pid=25529): Terminated: ok {rc=0} 01:45:38.999703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25531): Launched 01:45:39.299551 run osmo-hlr_10.42.42.2(pid=25532): Launched 01:45:39.412723 run osmo-stp_10.42.42.5: Starting osmo-stp 01:45:39.924515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25534): Launched 01:45:40.250045 run osmo-stp_10.42.42.5(pid=25535): Launched 01:45:40.373728 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:45:40.926289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25537): Launched 01:45:41.048718 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:45:41.318495 run patchelf(pid=25538): Launched 01:45:41.497072 run osmo-stp_10.42.42.5(pid=25535): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25535)] 01:45:41.632217 run osmo-stp_10.42.42.5(pid=25535): stdout: | (launched: 2022-12-14_01:45:40.190681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:41.769197 run osmo-stp_10.42.42.5(pid=25535): stderr: | [0;m[38;5;43m20221214014540381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014540381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014540381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014540382 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014540382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014540382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014540382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:41.906785 run osmo-stp_10.42.42.5(pid=25535): stdout: | (launched: 2022-12-14_01:45:40.190681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:42.037609 run osmo-stp_10.42.42.5(pid=25535): stderr: | [0;m[38;5;43m20221214014540381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014540381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014540381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014540382 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014540382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014540382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014540382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:42.192632 run patchelf(pid=25538): Terminating (SIGINT) 01:45:42.371292 run patchelf(pid=25538): Terminated: ok {rc=0} 01:45:42.499820 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25535): Process ended prematurely: osmo-stp_10.42.42.5(pid=25535) [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25535)] [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 01:45:42.509506 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 01:45:42.537476 run osmo-hlr_10.42.42.2(pid=25532): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25532)] 01:45:42.587424 run osmo-hlr_10.42.42.2(pid=25532): stdout: | (launched: 2022-12-14_01:45:39.243244) 01:45:42.638872 run osmo-hlr_10.42.42.2(pid=25532): stderr: | [0;m[1;31m20221214014539416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014539416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014539416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014539417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014539417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014539417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014539429 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014539439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014539439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014539439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:45:42.691071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25531): Terminating (SIGTERM) 01:45:42.732256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25534): Terminating (SIGTERM) 01:45:42.773911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25537): Terminating (SIGTERM) 01:45:42.815746 --- ParallelTerminationStrategy: PID 25531 died... 01:45:42.835915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25531): Terminated: ok {rc=0} 01:45:42.882138 --- ParallelTerminationStrategy: PID 25534 died... 01:45:42.901954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25534): Terminated: ok {rc=0} 01:45:42.947690 --- ParallelTerminationStrategy: PID 25537 died... 01:45:42.967357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25537): Terminated: ok {rc=0} 01:45:43.054799 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:45:44.351788 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:45:44.359225 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:45:44.383261 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:45:44.422076 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:45:44.507281 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:45:44.530749 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:45:44.568695 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:45:45.166310 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:45:45.214952 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:45.226151 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:45:45.285106 tst cs_paging_gprs_active.py: using LAC 37688 01:45:45.402304 tst cs_paging_gprs_active.py: using RAC 203 01:45:45.520453 tst cs_paging_gprs_active.py: using CellId 37688 01:45:45.637575 tst cs_paging_gprs_active.py: using BVCI 37689 01:45:45.748471 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:45.759601 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:45.770484 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:45.781312 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:45.792028 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:45.802869 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:45.813868 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:45.824413 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:45.847240 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:45:45.991028 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:45:46.142128 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:45:46.409239 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:46.746500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25542): Launched 01:45:47.052534 run iperf3-srv_10.42.42.10(pid=25543): Launched 01:45:47.191678 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:45:47.414519 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:47.742340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25544): Launched 01:45:48.027130 run iperf3-srv_10.42.42.10(pid=25545): Launched 01:45:48.149097 tst cs_paging_gprs_active.py:38: start network... 01:45:48.368347 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:45:48.871146 run create_hlr_db(pid=25546): Launched 01:45:48.997374 bus /gobi_6: Setting Powered False 01:45:50.060520 run create_hlr_db(pid=25546): Terminated: ok {rc=0} 01:45:50.494745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25548): Launched 01:45:50.798865 run osmo-hlr_10.42.42.2(pid=25549): Launched 01:45:50.913445 run osmo-stp_10.42.42.5: Starting osmo-stp 01:45:51.450718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25551): Launched 01:45:51.752883 run osmo-stp_10.42.42.5(pid=25552): Launched 01:45:51.867225 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:45:52.390776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25556): Launched 01:45:52.507544 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:45:52.763469 run patchelf(pid=25557): Launched 01:45:52.933149 run osmo-stp_10.42.42.5(pid=25552): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25552)] 01:45:53.060632 run osmo-stp_10.42.42.5(pid=25552): stdout: | (launched: 2022-12-14_01:45:51.696030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:53.190469 run osmo-stp_10.42.42.5(pid=25552): stderr: | [0;m[38;5;43m20221214014551866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014551866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014551866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014551866 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014551867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014551867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014551867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:53.319806 run osmo-stp_10.42.42.5(pid=25552): stdout: | (launched: 2022-12-14_01:45:51.696030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:45:53.442885 run osmo-stp_10.42.42.5(pid=25552): stderr: | [0;m[38;5;43m20221214014551866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014551866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014551866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014551866 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014551867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014551867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014551867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:45:53.588674 run patchelf(pid=25557): Terminating (SIGINT) 01:45:53.757554 run patchelf(pid=25557): Terminated: ok {rc=0} 01:45:53.879142 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25552): Process ended prematurely: osmo-stp_10.42.42.5(pid=25552) [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25552)] [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:45:53.888649 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 01:45:53.915590 run osmo-hlr_10.42.42.2(pid=25549): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25549)] 01:45:53.962789 run osmo-hlr_10.42.42.2(pid=25549): stdout: | (launched: 2022-12-14_01:45:50.742433) 01:45:54.010995 run osmo-hlr_10.42.42.2(pid=25549): stderr: | [0;m[1;31m20221214014550915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014550915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014550915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014550915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014550915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014550915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014550929 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014550939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014550940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014550940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:45:54.059891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25542): Terminating (SIGTERM) 01:45:54.099346 run iperf3-srv_10.42.42.10(pid=25543): Terminating (SIGTERM) 01:45:54.138470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25544): Terminating (SIGTERM) 01:45:54.177234 run iperf3-srv_10.42.42.10(pid=25545): Terminating (SIGTERM) 01:45:54.215997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25548): Terminating (SIGTERM) 01:45:54.255082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25551): Terminating (SIGTERM) 01:45:54.293877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25556): Terminating (SIGTERM) 01:45:54.332891 --- ParallelTerminationStrategy: PID 25542 died... 01:45:54.351983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25542): Terminated: ok {rc=0} 01:45:54.395163 --- ParallelTerminationStrategy: PID 25543 died... 01:45:54.413512 run iperf3-srv_10.42.42.10(pid=25543): Terminated {rc=256} 01:45:54.456519 --- ParallelTerminationStrategy: PID 25544 died... 01:45:54.475054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25544): Terminated: ok {rc=0} 01:45:54.518096 --- ParallelTerminationStrategy: PID 25545 died... 01:45:54.536423 run iperf3-srv_10.42.42.10(pid=25545): Terminated {rc=256} 01:45:54.579413 --- ParallelTerminationStrategy: PID 25548 died... 01:45:54.597819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25548): Terminated: ok {rc=0} 01:45:54.641061 --- ParallelTerminationStrategy: PID 25551 died... 01:45:54.659599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25551): Terminated: ok {rc=0} 01:45:54.702889 --- ParallelTerminationStrategy: PID 25556 died... 01:45:54.721353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25556): Terminated: ok {rc=0} 01:45:54.805655 bus /gobi_0: Setting Powered False 01:45:55.906518 bus /gobi_0: Setting Powered False 01:45:57.024854 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:45:58.171328 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:58.183023 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:45:58.245348 tst iperf3.py: using LAC 37689 01:45:58.363498 tst iperf3.py: using RAC 204 01:45:58.482313 tst iperf3.py: using CellId 37689 01:45:58.601377 tst iperf3.py: using BVCI 37690 01:45:58.710235 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:58.721338 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:58.732214 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:58.742997 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:58.753900 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:58.764612 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:58.775500 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:58.786143 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:45:58.797226 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:45:58.916601 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:45:59.136153 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:45:59.463413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25558): Launched 01:45:59.747458 run iperf3-srv_10.42.42.10(pid=25559): Launched 01:45:59.871299 tst iperf3.py:8: start network... 01:46:00.090233 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:46:00.592180 run create_hlr_db(pid=25560): Launched 01:46:00.715310 bus /gobi_6: Setting Powered False 01:46:01.790226 run create_hlr_db(pid=25560): Terminated: ok {rc=0} 01:46:02.282177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25562): Launched 01:46:02.615290 run osmo-hlr_10.42.42.2(pid=25563): Launched 01:46:02.738574 run osmo-stp_10.42.42.5: Starting osmo-stp 01:46:03.298271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25565): Launched 01:46:03.623688 run osmo-stp_10.42.42.5(pid=25566): Launched 01:46:03.746466 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:46:04.305164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25568): Launched 01:46:04.430887 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:46:04.705148 run patchelf(pid=25569): Launched 01:46:04.887543 run osmo-stp_10.42.42.5(pid=25566): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25566)] 01:46:05.025474 run osmo-stp_10.42.42.5(pid=25566): stdout: | (launched: 2022-12-14_01:46:03.563407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:05.164724 run osmo-stp_10.42.42.5(pid=25566): stderr: | [0;m[38;5;43m20221214014603753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014603754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014603754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014603754 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014603755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014603755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014603755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:05.303922 run osmo-stp_10.42.42.5(pid=25566): stdout: | (launched: 2022-12-14_01:46:03.563407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:05.436396 run osmo-stp_10.42.42.5(pid=25566): stderr: | [0;m[38;5;43m20221214014603753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014603754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014603754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014603754 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014603755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014603755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014603755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:05.593766 run patchelf(pid=25569): Terminating (SIGINT) 01:46:05.775254 run patchelf(pid=25569): Terminated: ok {rc=0} 01:46:05.907036 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25566): Process ended prematurely: osmo-stp_10.42.42.5(pid=25566) [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25566)] [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 01:46:05.917450 tst iperf3.py:8: Test FAILED (7.8 sec) 01:46:05.946004 run osmo-hlr_10.42.42.2(pid=25563): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25563)] 01:46:05.996412 run osmo-hlr_10.42.42.2(pid=25563): stdout: | (launched: 2022-12-14_01:46:02.555411) 01:46:06.048582 run osmo-hlr_10.42.42.2(pid=25563): stderr: | [0;m[1;31m20221214014602751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014602751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014602751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014602751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014602751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014602751 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014602763 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014602771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014602772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014602772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:46:06.100904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25558): Terminating (SIGTERM) 01:46:06.142787 run iperf3-srv_10.42.42.10(pid=25559): Terminating (SIGTERM) 01:46:06.185090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25562): Terminating (SIGTERM) 01:46:06.227387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25565): Terminating (SIGTERM) 01:46:06.269553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25568): Terminating (SIGTERM) 01:46:06.311893 --- ParallelTerminationStrategy: PID 25558 died... 01:46:06.332352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25558): Terminated: ok {rc=0} 01:46:06.378975 --- ParallelTerminationStrategy: PID 25559 died... 01:46:06.398883 run iperf3-srv_10.42.42.10(pid=25559): Terminated {rc=256} 01:46:06.444887 --- ParallelTerminationStrategy: PID 25562 died... 01:46:06.465065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25562): Terminated: ok {rc=0} 01:46:06.510848 --- ParallelTerminationStrategy: PID 25565 died... 01:46:06.530713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25565): Terminated: ok {rc=0} 01:46:06.576701 --- ParallelTerminationStrategy: PID 25568 died... 01:46:06.596468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25568): Terminated: ok {rc=0} 01:46:06.685267 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:46:07.832103 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:07.844200 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:46:07.905111 tst iperf3m4.py: using LAC 37690 01:46:08.025056 tst iperf3m4.py: using RAC 205 01:46:08.143340 tst iperf3m4.py: using CellId 37690 01:46:08.264153 tst iperf3m4.py: using BVCI 37691 01:46:08.374400 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:08.385591 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:08.396405 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:08.407234 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:08.418027 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:08.428838 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:08.439936 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:08.450661 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:08.461695 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:46:08.577804 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:46:08.699833 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:46:08.817830 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:46:08.936797 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:46:09.156330 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:46:09.483291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25570): Launched 01:46:09.769026 run iperf3-srv_10.42.42.10(pid=25571): Launched 01:46:09.893178 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:46:10.112398 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:46:10.440612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25572): Launched 01:46:10.723793 run iperf3-srv_10.42.42.10(pid=25573): Launched 01:46:10.847354 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:46:11.065705 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:46:11.392407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25574): Launched 01:46:11.677096 run iperf3-srv_10.42.42.10(pid=25575): Launched 01:46:11.800434 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:46:12.019096 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:46:12.347024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25576): Launched 01:46:12.630763 run iperf3-srv_10.42.42.10(pid=25577): Launched 01:46:12.754125 tst iperf3m4.py:8: start network... 01:46:12.973006 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:46:13.476395 run create_hlr_db(pid=25578): Launched 01:46:13.600428 bus /gobi_6: Setting Powered False 01:46:14.660800 run create_hlr_db(pid=25578): Terminated: ok {rc=0} 01:46:15.113190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25580): Launched 01:46:15.439316 run osmo-hlr_10.42.42.2(pid=25581): Launched 01:46:15.564528 run osmo-stp_10.42.42.5: Starting osmo-stp 01:46:16.169283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25583): Launched 01:46:16.497802 run osmo-stp_10.42.42.5(pid=25584): Launched 01:46:16.761411 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:46:17.393569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25586): Launched 01:46:17.509503 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:46:17.766458 run patchelf(pid=25587): Launched 01:46:17.935979 run osmo-stp_10.42.42.5(pid=25584): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25584)] 01:46:18.063358 run osmo-stp_10.42.42.5(pid=25584): stdout: | (launched: 2022-12-14_01:46:16.434686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:18.192790 run osmo-stp_10.42.42.5(pid=25584): stderr: | [0;m[38;5;43m20221214014616687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014616687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014616687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014616688 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014616688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014616688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014616688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:18.323331 run osmo-stp_10.42.42.5(pid=25584): stdout: | (launched: 2022-12-14_01:46:16.434686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:18.445864 run osmo-stp_10.42.42.5(pid=25584): stderr: | [0;m[38;5;43m20221214014616687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014616687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014616687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014616688 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014616688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014616688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014616688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:18.591463 run patchelf(pid=25587): Terminating (SIGINT) 01:46:18.760022 run patchelf(pid=25587): Terminated: ok {rc=0} 01:46:18.881924 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25584): Process ended prematurely: osmo-stp_10.42.42.5(pid=25584) [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25584)] [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:46:18.891385 tst iperf3m4.py:8: Test FAILED (11.1 sec) 01:46:18.918765 run osmo-hlr_10.42.42.2(pid=25581): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25581)] 01:46:18.965750 run osmo-hlr_10.42.42.2(pid=25581): stdout: | (launched: 2022-12-14_01:46:15.379152) 01:46:19.014123 run osmo-hlr_10.42.42.2(pid=25581): stderr: | [0;m[1;31m20221214014615575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014615575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014615575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014615575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014615575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014615575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014615588 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014615596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014615596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014615596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:46:19.062989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25570): Terminating (SIGTERM) 01:46:19.101786 run iperf3-srv_10.42.42.10(pid=25571): Terminating (SIGTERM) 01:46:19.140720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25572): Terminating (SIGTERM) 01:46:19.179721 run iperf3-srv_10.42.42.10(pid=25573): Terminating (SIGTERM) 01:46:19.218577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25574): Terminating (SIGTERM) 01:46:19.257492 run iperf3-srv_10.42.42.10(pid=25575): Terminating (SIGTERM) 01:46:19.296396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25576): Terminating (SIGTERM) 01:46:19.335362 run iperf3-srv_10.42.42.10(pid=25577): Terminating (SIGTERM) 01:46:19.374129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25580): Terminating (SIGTERM) 01:46:19.413124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25583): Terminating (SIGTERM) 01:46:19.452021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25586): Terminating (SIGTERM) 01:46:19.491023 --- ParallelTerminationStrategy: PID 25570 died... 01:46:19.509911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25570): Terminated: ok {rc=0} 01:46:19.553156 --- ParallelTerminationStrategy: PID 25571 died... 01:46:19.571604 run iperf3-srv_10.42.42.10(pid=25571): Terminated {rc=256} 01:46:19.614879 --- ParallelTerminationStrategy: PID 25572 died... 01:46:19.633411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25572): Terminated: ok {rc=0} 01:46:19.676610 --- ParallelTerminationStrategy: PID 25573 died... 01:46:19.695189 run iperf3-srv_10.42.42.10(pid=25573): Terminated {rc=256} 01:46:19.738196 --- ParallelTerminationStrategy: PID 25574 died... 01:46:19.756723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25574): Terminated: ok {rc=0} 01:46:19.799795 --- ParallelTerminationStrategy: PID 25575 died... 01:46:19.818768 run iperf3-srv_10.42.42.10(pid=25575): Terminated {rc=256} 01:46:19.861898 --- ParallelTerminationStrategy: PID 25576 died... 01:46:19.880372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25576): Terminated: ok {rc=0} 01:46:19.923596 --- ParallelTerminationStrategy: PID 25577 died... 01:46:19.942061 run iperf3-srv_10.42.42.10(pid=25577): Terminated {rc=256} 01:46:19.985153 --- ParallelTerminationStrategy: PID 25580 died... 01:46:20.003728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25580): Terminated: ok {rc=0} 01:46:20.046895 --- ParallelTerminationStrategy: PID 25583 died... 01:46:20.065521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25583): Terminated: ok {rc=0} 01:46:20.109776 --- ParallelTerminationStrategy: PID 25586 died... 01:46:20.128313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25586): Terminated: ok {rc=0} 01:46:20.211413 bus /gobi_4: Setting Powered False 01:46:21.308687 bus /gobi_4: Setting Powered False 01:46:22.423735 bus /gobi_1: Setting Powered False 01:46:23.519756 bus /gobi_1: Setting Powered False 01:46:24.634121 bus /gobi_0: Setting Powered False 01:46:25.734666 bus /gobi_0: Setting Powered False 01:46:26.850666 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:46:27.953111 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:27.965423 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:46:28.027795 tst ping.py: using LAC 37691 01:46:28.154261 tst ping.py: using RAC 206 01:46:28.280045 tst ping.py: using CellId 37691 01:46:28.405172 tst ping.py: using BVCI 37692 01:46:28.512213 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:28.523501 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:28.537336 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:28.548807 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:28.560645 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:28.572531 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:28.584748 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:28.596503 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:46:28.712593 tst ping.py:19: start network... 01:46:28.910232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:46:29.369270 run create_hlr_db(pid=25588): Launched 01:46:29.492053 bus /gobi_6: Setting Powered False 01:46:30.551602 run create_hlr_db(pid=25588): Terminated: ok {rc=0} 01:46:31.008274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25590): Launched 01:46:31.348263 run osmo-hlr_10.42.42.2(pid=25591): Launched 01:46:31.506699 run osmo-stp_10.42.42.5: Starting osmo-stp 01:46:32.194632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25593): Launched 01:46:32.510128 run osmo-stp_10.42.42.5(pid=25594): Launched 01:46:32.622258 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:46:33.136423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25596): Launched 01:46:33.250332 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:46:33.500530 run patchelf(pid=25597): Launched 01:46:33.664248 run osmo-stp_10.42.42.5(pid=25594): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25594)] 01:46:33.789168 run osmo-stp_10.42.42.5(pid=25594): stdout: | (launched: 2022-12-14_01:46:32.453729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:33.916088 run osmo-stp_10.42.42.5(pid=25594): stderr: | [0;m[38;5;43m20221214014632623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014632623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014632623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014632623 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014632624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014632624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014632624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:34.042986 run osmo-stp_10.42.42.5(pid=25594): stdout: | (launched: 2022-12-14_01:46:32.453729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:34.163769 run osmo-stp_10.42.42.5(pid=25594): stderr: | [0;m[38;5;43m20221214014632623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014632623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014632623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014632623 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014632624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014632624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014632624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:34.306955 run patchelf(pid=25597): Terminating (SIGINT) 01:46:34.473124 run patchelf(pid=25597): Terminated: ok {rc=0} 01:46:34.592273 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25594): Process ended prematurely: osmo-stp_10.42.42.5(pid=25594) [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25594)] [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 01:46:34.601307 tst ping.py:22: Test FAILED (6.6 sec) 01:46:34.627761 run osmo-hlr_10.42.42.2(pid=25591): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25591)] 01:46:34.674521 run osmo-hlr_10.42.42.2(pid=25591): stdout: | (launched: 2022-12-14_01:46:31.286858) 01:46:34.723014 run osmo-hlr_10.42.42.2(pid=25591): stderr: | [0;m[1;31m20221214014631612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014631617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014631617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014631617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014631617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014631617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014631631 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014631643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014631643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014631644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:46:34.771796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25590): Terminating (SIGTERM) 01:46:34.810581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25593): Terminating (SIGTERM) 01:46:34.849390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25596): Terminating (SIGTERM) 01:46:34.888813 --- ParallelTerminationStrategy: PID 25590 died... 01:46:34.907980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25590): Terminated: ok {rc=0} 01:46:34.951282 --- ParallelTerminationStrategy: PID 25593 died... 01:46:34.969705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25593): Terminated: ok {rc=0} 01:46:35.012471 --- ParallelTerminationStrategy: PID 25596 died... 01:46:35.030776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25596): Terminated: ok {rc=0} 01:46:35.113333 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:46:36.195584 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:36.207546 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:46:36.268277 tst ping_idle_ping.py: using LAC 37692 01:46:36.384768 tst ping_idle_ping.py: using RAC 207 01:46:36.503469 tst ping_idle_ping.py: using CellId 37692 01:46:36.619896 tst ping_idle_ping.py: using BVCI 37693 01:46:36.728325 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:36.739605 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:36.750825 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:36.761832 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:36.772629 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:36.783587 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:36.794786 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:46:36.805683 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:46:36.919705 tst ping_idle_ping.py:24: start network... 01:46:37.117716 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:46:37.580268 run create_hlr_db(pid=25598): Launched 01:46:37.701671 bus /gobi_6: Setting Powered False 01:46:38.763823 run create_hlr_db(pid=25598): Terminated: ok {rc=0} 01:46:39.209361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25600): Launched 01:46:39.529305 run osmo-hlr_10.42.42.2(pid=25601): Launched 01:46:39.645788 run osmo-stp_10.42.42.5: Starting osmo-stp 01:46:40.176916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25603): Launched 01:46:40.497669 run osmo-stp_10.42.42.5(pid=25604): Launched 01:46:40.621514 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:46:41.174383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25606): Launched 01:46:41.296841 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:46:41.566281 run patchelf(pid=25607): Launched 01:46:41.745048 run osmo-stp_10.42.42.5(pid=25604): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25604)] 01:46:41.879810 run osmo-stp_10.42.42.5(pid=25604): stdout: | (launched: 2022-12-14_01:46:40.438325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:42.016279 run osmo-stp_10.42.42.5(pid=25604): stderr: | [0;m[38;5;43m20221214014640631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014640631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014640632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014640632 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014640632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014640633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014640633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:42.152810 run osmo-stp_10.42.42.5(pid=25604): stdout: | (launched: 2022-12-14_01:46:40.438325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:42.282953 run osmo-stp_10.42.42.5(pid=25604): stderr: | [0;m[38;5;43m20221214014640631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014640631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014640632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014640632 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014640632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014640633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014640633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:42.437160 run patchelf(pid=25607): Terminating (SIGINT) 01:46:42.614976 run patchelf(pid=25607): Terminated: ok {rc=0} 01:46:42.742836 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25604): Process ended prematurely: osmo-stp_10.42.42.5(pid=25604) [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25604)] [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:46:42.752290 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 01:46:42.780221 run osmo-hlr_10.42.42.2(pid=25601): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25601)] 01:46:42.830270 run osmo-hlr_10.42.42.2(pid=25601): stdout: | (launched: 2022-12-14_01:46:39.469902) 01:46:42.882378 run osmo-hlr_10.42.42.2(pid=25601): stderr: | [0;m[1;31m20221214014639642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014639642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014639642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014639642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014639642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014639642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014639654 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014639662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014639662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014639663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:46:42.934383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25600): Terminating (SIGTERM) 01:46:42.975806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25603): Terminating (SIGTERM) 01:46:43.018155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25606): Terminating (SIGTERM) 01:46:43.060640 --- ParallelTerminationStrategy: PID 25600 died... 01:46:43.081095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25600): Terminated: ok {rc=0} 01:46:43.126984 --- ParallelTerminationStrategy: PID 25603 died... 01:46:43.146854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25603): Terminated: ok {rc=0} 01:46:43.192689 --- ParallelTerminationStrategy: PID 25606 died... 01:46:43.212509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25606): Terminated: ok {rc=0} 01:46:43.299800 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 01:46:44.598372 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:46:44.606569 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:46:44.631110 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:46:44.667152 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:46:44.721849 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:46:44.745549 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:46:44.779856 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:46:45.340160 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2397 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:46:45.345511 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:46:45.357195 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:46:45.417228 tst switch_tch_pdch.py: using LAC 37693 01:46:45.532213 tst switch_tch_pdch.py: using RAC 208 01:46:45.647404 tst switch_tch_pdch.py: using CellId 37693 01:46:45.765315 tst switch_tch_pdch.py: using BVCI 37694 01:46:45.897486 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:46:45.909897 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:46:45.922065 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:46:45.934433 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:46:45.946618 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:46:45.958640 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:46:45.971168 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:46:45.983425 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:46:46.101323 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:46:46.221129 tst switch_tch_pdch.py:51: start network... 01:46:46.426453 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:46:46.897970 run create_hlr_db(pid=25611): Launched 01:46:47.057204 bus /gobi_6: Setting Powered False 01:46:48.117246 run create_hlr_db(pid=25611): Terminated: ok {rc=0} 01:46:48.534778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25613): Launched 01:46:48.833380 run osmo-hlr_10.42.42.2(pid=25614): Launched 01:46:48.946407 run osmo-stp_10.42.42.5: Starting osmo-stp 01:46:49.456001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25616): Launched 01:46:49.753285 run osmo-stp_10.42.42.5(pid=25617): Launched 01:46:49.865792 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:46:50.377185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25619): Launched 01:46:50.491387 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:46:50.742561 run patchelf(pid=25620): Launched 01:46:50.909329 run osmo-stp_10.42.42.5(pid=25617): ERR: Terminated: ERROR {rc=1} [trial-2397↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25617)] 01:46:51.034310 run osmo-stp_10.42.42.5(pid=25617): stdout: | (launched: 2022-12-14_01:46:49.697595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:51.161515 run osmo-stp_10.42.42.5(pid=25617): stderr: | [0;m[38;5;43m20221214014649866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014649866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014649866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014649867 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014649867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014649867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014649867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:51.288394 run osmo-stp_10.42.42.5(pid=25617): stdout: | (launched: 2022-12-14_01:46:49.697595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:46:51.409658 run osmo-stp_10.42.42.5(pid=25617): stderr: | [0;m[38;5;43m20221214014649866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014649866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014649866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014649867 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014649867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014649867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014649867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:46:51.553326 run patchelf(pid=25620): Terminating (SIGINT) 01:46:51.718954 run patchelf(pid=25620): Terminated: ok {rc=0} 01:46:51.838354 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25617): Process ended prematurely: osmo-stp_10.42.42.5(pid=25617) [trial-2397↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25617)] [trial-2397↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:46:51.847784 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 01:46:51.874752 run osmo-hlr_10.42.42.2(pid=25614): ERR: Terminated: ERROR {rc=237} [trial-2397↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25614)] 01:46:51.921991 run osmo-hlr_10.42.42.2(pid=25614): stdout: | (launched: 2022-12-14_01:46:48.777587) 01:46:51.970835 run osmo-hlr_10.42.42.2(pid=25614): stderr: | [0;m[1;31m20221214014648952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014648952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014648952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014648952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014648952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014648952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014648967 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014648975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014648976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014648976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:46:52.019944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25613): Terminating (SIGTERM) 01:46:52.059509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25616): Terminating (SIGTERM) 01:46:52.098838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25619): Terminating (SIGTERM) 01:46:52.138456 --- ParallelTerminationStrategy: PID 25613 died... 01:46:52.157872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25613): Terminated: ok {rc=0} 01:46:52.201314 --- ParallelTerminationStrategy: PID 25616 died... 01:46:52.219915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25616): Terminated: ok {rc=0} 01:46:52.263070 --- ParallelTerminationStrategy: PID 25619 died... 01:46:52.281633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25619): Terminated: ok {rc=0} 01:46:52.363721 bus /gobi_0: Setting Powered False 01:46:53.458219 bus /gobi_0: Setting Powered False 01:46:54.572700 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 sms:nanobts+band-900 --------------------------------------------------------------------- 01:46:55.822316 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:46:55.827523 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 01:46:55.860353 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 01:46:55.888713 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 01:46:55.940681 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 01:46:55.972744 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 01:46:55.999281 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 01:46:56.548657 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 01:46:56.553912 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:46:56.564771 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 01:46:56.610282 tst mo_mt_sms.py: using LAC 37694 01:46:56.725359 tst mo_mt_sms.py: using RAC 209 01:46:56.840764 tst mo_mt_sms.py: using CellId 37694 01:46:56.957240 tst mo_mt_sms.py: using BVCI 37695 01:46:57.063280 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:46:57.074063 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:46:57.084559 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:46:57.095093 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:46:57.105660 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:46:57.115980 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 01:46:57.235018 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 01:46:57.355580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:46:57.848610 run create_hlr_db(pid=25624): Launched 01:46:57.971417 bus /gobi_6: Setting Powered False 01:46:59.034849 run create_hlr_db(pid=25624): Terminated: ok {rc=0} 01:46:59.480585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25626): Launched 01:46:59.798834 run osmo-hlr_10.42.42.2(pid=25627): Launched 01:46:59.922013 run osmo-stp_10.42.42.5: Starting osmo-stp 01:47:00.472567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25629): Launched 01:47:00.792074 run osmo-stp_10.42.42.5(pid=25630): Launched 01:47:01.024681 run osmo-msc_10.42.42.6: Starting osmo-msc 01:47:01.750084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25632): Launched 01:47:02.086257 run osmo-msc_10.42.42.6(pid=25633): Launched 01:47:02.373387 run osmo-stp_10.42.42.5(pid=25630): ERR: Terminated: ERROR {rc=1} [trial-2397↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25630)] 01:47:02.504024 run osmo-stp_10.42.42.5(pid=25630): stdout: | (launched: 2022-12-14_01:47:00.732551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:02.629635 run osmo-stp_10.42.42.5(pid=25630): stderr: | [0;m[38;5;43m20221214014700995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014700995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014700995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014700996 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014700997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014700997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014700997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:02.754287 run osmo-stp_10.42.42.5(pid=25630): stdout: | (launched: 2022-12-14_01:47:00.732551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:02.872806 run osmo-stp_10.42.42.5(pid=25630): stderr: | [0;m[38;5;43m20221214014700995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014700995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014700995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014700996 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014700997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014700997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014700997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:03.014488 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=25630): Process ended prematurely: osmo-stp_10.42.42.5(pid=25630) [trial-2397↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25630)] [trial-2397↪sms:nanobts+band-900↪mo_mt_sms.py:16] 01:47:03.023092 tst mo_mt_sms.py:16: Test FAILED (6.5 sec) 01:47:03.049359 run osmo-hlr_10.42.42.2(pid=25627): ERR: Terminated: ERROR {rc=237} [trial-2397↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25627)] 01:47:03.096720 run osmo-hlr_10.42.42.2(pid=25627): stdout: | (launched: 2022-12-14_01:46:59.740122) 01:47:03.145820 run osmo-hlr_10.42.42.2(pid=25627): stderr: | [0;m[1;31m20221214014659935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014659935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014659935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014659935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014659935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014659935 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014659947 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014659956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014659956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014659956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:47:03.214501 run osmo-msc_10.42.42.6(pid=25633): ERR: Terminated: ERROR {rc=2} [trial-2397↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25633)] 01:47:03.261647 run osmo-msc_10.42.42.6(pid=25633): stdout: | (launched: 2022-12-14_01:47:02.025571) 01:47:03.310536 run osmo-msc_10.42.42.6(pid=25633): stderr: | [0;m[38;5;43m20221214014702381 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014702382 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f77522e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014702382 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014702382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014702382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014702382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014702384 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014702384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014702384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014702384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:47:03.359804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25626): Terminating (SIGTERM) 01:47:03.399285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25629): Terminating (SIGTERM) 01:47:03.438863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25632): Terminating (SIGTERM) 01:47:03.478609 --- ParallelTerminationStrategy: PID 25626 died... 01:47:03.497971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25626): Terminated: ok {rc=0} 01:47:03.542227 --- ParallelTerminationStrategy: PID 25629 died... 01:47:03.560804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25629): Terminated: ok {rc=0} 01:47:03.604704 --- ParallelTerminationStrategy: PID 25632 died... 01:47:03.623480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25632): Terminated: ok {rc=0} 01:47:03.708827 bus /sierra_3: Setting Powered False 01:47:04.807786 bus /sierra_3: Setting Powered False 01:47:05.921389 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 01:47:07.153721 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:47:07.158537 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 01:47:07.190125 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 01:47:07.197004 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 01:47:07.231996 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 01:47:07.264117 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 01:47:07.270880 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 01:47:07.789814 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2397 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 01:47:07.794829 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 01:47:07.805833 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 01:47:07.851652 tst assert_extension.py: using LAC 37695 01:47:07.969369 tst assert_extension.py: using RAC 210 01:47:08.097641 tst assert_extension.py: using CellId 37695 01:47:08.225344 tst assert_extension.py: using BVCI 37696 01:47:08.342153 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 01:47:08.456180 tst assert_extension.py:10: start nitb and bts... 01:47:08.655343 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:47:09.265225 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25638): Launched 01:47:09.562833 run osmo-nitb_10.42.42.2(pid=25639): Launched 01:47:09.729513 run osmo-nitb_10.42.42.2(pid=25639): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25639)] 01:47:09.862946 run osmo-nitb_10.42.42.2(pid=25639): stdout: | (launched: 2022-12-14_01:47:09.507171) 01:47:09.998880 run osmo-nitb_10.42.42.2(pid=25639): stderr: | (launched: 2022-12-14_01:47:09.551185) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:47:10.134132 run osmo-nitb_10.42.42.2(pid=25639): stdout: | (launched: 2022-12-14_01:47:09.507171) 01:47:10.264092 run osmo-nitb_10.42.42.2(pid=25639): stderr: | (launched: 2022-12-14_01:47:09.551185) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8b7301f268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25639): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25639) [trial-2397↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25639)] 01:47:10.676529 tst osmo-nitb_10.42.42.2(pid=25639): stdout: | (launched: 2022-12-14_01:47:09.507171) 01:47:10.797356 tst osmo-nitb_10.42.42.2(pid=25639): stderr: | (launched: 2022-12-14_01:47:09.551185) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:47:10.938688 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=25639): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25639) [trial-2397↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25639)] [trial-2397↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 01:47:10.947201 tst assert_extension.py:12: Test FAILED (3.1 sec) 01:47:10.953877 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25638): Terminating (SIGTERM) 01:47:11.161956 --- ParallelTerminationStrategy: PID 25638 died... 01:47:11.182994 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25638): Terminated: ok {rc=0} 01:47:11.266819 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 ussd:nanobts+band-900 --------------------------------------------------------------------- 01:47:12.444665 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:47:12.449928 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 01:47:12.482745 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 01:47:12.510787 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 01:47:12.547221 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 01:47:12.580587 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 01:47:12.608153 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 01:47:13.137313 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2397 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 01:47:13.142664 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:47:13.153941 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 01:47:13.216340 tst assert_extension.py: using LAC 37696 01:47:13.339379 tst assert_extension.py: using RAC 211 01:47:13.464927 tst assert_extension.py: using CellId 37696 01:47:13.592872 tst assert_extension.py: using BVCI 37697 01:47:13.710115 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:47:13.721443 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:47:13.732466 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:47:13.743472 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:47:13.754897 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:47:13.766167 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 01:47:13.880796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:47:14.342154 run create_hlr_db(pid=25643): Launched 01:47:14.466657 bus /sierra_2: Setting Powered False 01:47:15.525915 run create_hlr_db(pid=25643): Terminated: ok {rc=0} 01:47:15.969978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25645): Launched 01:47:16.313852 run osmo-hlr_10.42.42.2(pid=25646): Launched 01:47:16.480903 run osmo-stp_10.42.42.5: Starting osmo-stp 01:47:17.153817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25648): Launched 01:47:17.482665 run osmo-stp_10.42.42.5(pid=25649): Launched 01:47:17.607194 run osmo-msc_10.42.42.6: Starting osmo-msc 01:47:18.186874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25651): Launched 01:47:18.507649 run osmo-msc_10.42.42.6(pid=25652): Launched 01:47:18.687655 run osmo-stp_10.42.42.5(pid=25649): ERR: Terminated: ERROR {rc=1} [trial-2397↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25649)] 01:47:18.821851 run osmo-stp_10.42.42.5(pid=25649): stdout: | (launched: 2022-12-14_01:47:17.423464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:18.957811 run osmo-stp_10.42.42.5(pid=25649): stderr: | [0;m[38;5;43m20221214014717611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014717611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014717611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014717612 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014717612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014717612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014717612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:19.091224 run osmo-stp_10.42.42.5(pid=25649): stdout: | (launched: 2022-12-14_01:47:17.423464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:19.218461 run osmo-stp_10.42.42.5(pid=25649): stderr: | [0;m[38;5;43m20221214014717611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014717611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014717611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014717612 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014717612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014717612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014717612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:19.370707 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=25649): Process ended prematurely: osmo-stp_10.42.42.5(pid=25649) [trial-2397↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25649)] [trial-2397↪ussd:nanobts+band-900↪assert_extension.py:17] 01:47:19.379711 tst assert_extension.py:17: Test FAILED (6.2 sec) 01:47:19.407283 run osmo-hlr_10.42.42.2(pid=25646): ERR: Terminated: ERROR {rc=237} [trial-2397↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25646)] 01:47:19.457469 run osmo-hlr_10.42.42.2(pid=25646): stdout: | (launched: 2022-12-14_01:47:16.254385) 01:47:19.508687 run osmo-hlr_10.42.42.2(pid=25646): stderr: | [0;m[1;31m20221214014716667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014716667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014716667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014716667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014716667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014716668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014716689 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014716707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014716707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014716708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:47:19.581034 run osmo-msc_10.42.42.6(pid=25652): ERR: Terminated: ERROR {rc=2} [trial-2397↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25652)] 01:47:19.630356 run osmo-msc_10.42.42.6(pid=25652): stdout: | (launched: 2022-12-14_01:47:18.448537) 01:47:19.681695 run osmo-msc_10.42.42.6(pid=25652): stderr: | [0;m[38;5;43m20221214014718766 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014718766 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff81b3dec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014718767 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014718767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014718767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014718767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014718769 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014718769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014718769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014718769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:47:19.733939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25645): Terminating (SIGTERM) 01:47:19.775308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25648): Terminating (SIGTERM) 01:47:19.817801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25651): Terminating (SIGTERM) 01:47:19.860515 --- ParallelTerminationStrategy: PID 25645 died... 01:47:19.881136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25645): Terminated: ok {rc=0} 01:47:19.928129 --- ParallelTerminationStrategy: PID 25648 died... 01:47:19.948287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25648): Terminated: ok {rc=0} 01:47:19.994735 --- ParallelTerminationStrategy: PID 25651 died... 01:47:20.014801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25651): Terminated: ok {rc=0} 01:47:20.103310 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 01:47:21.315122 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:47:21.323159 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 01:47:21.357399 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 01:47:21.385843 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 01:47:21.437682 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 01:47:21.471412 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 01:47:21.500142 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 01:47:22.051404 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 01:47:22.105481 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:22.117331 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:47:22.189749 tst mo_mt_call.py: using LAC 37697 01:47:22.315570 tst mo_mt_call.py: using RAC 212 01:47:22.445812 tst mo_mt_call.py: using CellId 37697 01:47:22.573400 tst mo_mt_call.py: using BVCI 37698 01:47:22.691179 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:22.702873 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:22.714439 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:22.725954 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:22.738981 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:22.751475 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:47:22.872469 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:47:22.995205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:47:23.499878 run create_hlr_db(pid=25658): Launched 01:47:23.625552 bus /sierra_2: Setting Powered False 01:47:24.690002 run create_hlr_db(pid=25658): Terminated: ok {rc=0} 01:47:25.124306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25660): Launched 01:47:25.430605 run osmo-hlr_10.42.42.2(pid=25661): Launched 01:47:25.546892 run osmo-stp_10.42.42.5: Starting osmo-stp 01:47:26.082362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25663): Launched 01:47:26.385276 run osmo-stp_10.42.42.5(pid=25664): Launched 01:47:26.500067 run osmo-msc_10.42.42.6: Starting osmo-msc 01:47:27.048141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25666): Launched 01:47:27.351036 run osmo-msc_10.42.42.6(pid=25667): Launched 01:47:27.520392 run osmo-stp_10.42.42.5(pid=25664): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25664)] 01:47:27.647335 run osmo-stp_10.42.42.5(pid=25664): stdout: | (launched: 2022-12-14_01:47:26.328126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:27.774654 run osmo-stp_10.42.42.5(pid=25664): stderr: | [0;m[38;5;43m20221214014726497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014726497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014726498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014726498 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014726499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014726499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014726499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:27.900108 run osmo-stp_10.42.42.5(pid=25664): stdout: | (launched: 2022-12-14_01:47:26.328126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:28.019489 run osmo-stp_10.42.42.5(pid=25664): stderr: | [0;m[38;5;43m20221214014726497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014726497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014726498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014726498 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014726499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014726499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014726499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:28.163111 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25664): Process ended prematurely: osmo-stp_10.42.42.5(pid=25664) [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25664)] [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 01:47:28.172219 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 01:47:28.198955 run osmo-hlr_10.42.42.2(pid=25661): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25661)] 01:47:28.246453 run osmo-hlr_10.42.42.2(pid=25661): stdout: | (launched: 2022-12-14_01:47:25.374154) 01:47:28.295451 run osmo-hlr_10.42.42.2(pid=25661): stderr: | [0;m[1;31m20221214014725547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014725547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014725547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014725547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014725547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014725547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014725559 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014725567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014725568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014725568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:47:28.364235 run osmo-msc_10.42.42.6(pid=25667): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25667)] 01:47:28.411530 run osmo-msc_10.42.42.6(pid=25667): stdout: | (launched: 2022-12-14_01:47:27.294423) 01:47:28.460485 run osmo-msc_10.42.42.6(pid=25667): stderr: | [0;m[38;5;43m20221214014727565 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014727566 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f289ea27c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014727566 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014727566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014727566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014727566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014727568 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014727568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014727568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014727568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:47:28.509757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25660): Terminating (SIGTERM) 01:47:28.549223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25663): Terminating (SIGTERM) 01:47:28.588576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25666): Terminating (SIGTERM) 01:47:28.628376 --- ParallelTerminationStrategy: PID 25660 died... 01:47:28.647598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25660): Terminated: ok {rc=0} 01:47:28.691434 --- ParallelTerminationStrategy: PID 25663 died... 01:47:28.710087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25663): Terminated: ok {rc=0} 01:47:28.753542 --- ParallelTerminationStrategy: PID 25666 died... 01:47:28.772140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25666): Terminated: ok {rc=0} 01:47:28.858180 bus /sierra_3: Setting Powered False 01:47:29.958116 bus /sierra_3: Setting Powered False 01:47:31.077790 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 01:47:32.241826 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:32.254336 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 01:47:32.322559 tst mo_mt_call_osmux.py: using LAC 37698 01:47:32.442782 tst mo_mt_call_osmux.py: using RAC 213 01:47:32.563385 tst mo_mt_call_osmux.py: using CellId 37698 01:47:32.688446 tst mo_mt_call_osmux.py: using BVCI 37699 01:47:32.799346 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:32.810802 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:32.821894 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:32.832897 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:32.844010 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 01:47:32.854958 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:47:32.970842 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 01:47:33.091441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:47:33.594793 run create_hlr_db(pid=25669): Launched 01:47:33.720549 bus /sierra_2: Setting Powered False 01:47:34.781797 run create_hlr_db(pid=25669): Terminated: ok {rc=0} 01:47:35.235806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25671): Launched 01:47:35.564789 run osmo-hlr_10.42.42.2(pid=25672): Launched 01:47:35.690330 run osmo-stp_10.42.42.5: Starting osmo-stp 01:47:36.247773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25674): Launched 01:47:36.574495 run osmo-stp_10.42.42.5(pid=25675): Launched 01:47:36.697576 run osmo-msc_10.42.42.6: Starting osmo-msc 01:47:37.284568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25677): Launched 01:47:37.610915 run osmo-msc_10.42.42.6(pid=25678): Launched 01:47:37.792530 run osmo-stp_10.42.42.5(pid=25675): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25675)] 01:47:37.929480 run osmo-stp_10.42.42.5(pid=25675): stdout: | (launched: 2022-12-14_01:47:36.513874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:38.066806 run osmo-stp_10.42.42.5(pid=25675): stderr: | [0;m[38;5;43m20221214014736703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014736703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014736703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014736703 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014736704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014736704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014736704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:38.202486 run osmo-stp_10.42.42.5(pid=25675): stdout: | (launched: 2022-12-14_01:47:36.513874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:38.330864 run osmo-stp_10.42.42.5(pid=25675): stderr: | [0;m[38;5;43m20221214014736703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014736703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014736703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014736703 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014736704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014736704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014736704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:38.485262 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25675): Process ended prematurely: osmo-stp_10.42.42.5(pid=25675) [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25675)] [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 01:47:38.494894 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 01:47:38.522572 run osmo-hlr_10.42.42.2(pid=25672): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25672)] 01:47:38.572531 run osmo-hlr_10.42.42.2(pid=25672): stdout: | (launched: 2022-12-14_01:47:35.504512) 01:47:38.623937 run osmo-hlr_10.42.42.2(pid=25672): stderr: | [0;m[1;31m20221214014735699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014735699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014735699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014735699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014735699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014735699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014735740 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014735749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014735750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014735750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:47:38.695790 run osmo-msc_10.42.42.6(pid=25678): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25678)] 01:47:38.744694 run osmo-msc_10.42.42.6(pid=25678): stdout: | (launched: 2022-12-14_01:47:37.550773) 01:47:38.795926 run osmo-msc_10.42.42.6(pid=25678): stderr: | [0;m[38;5;43m20221214014737869 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014737869 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb6b8fd5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014737869 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014737869 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014737870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014737870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014737871 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014737872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014737873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014737873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:47:38.847592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25671): Terminating (SIGTERM) 01:47:38.889279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25674): Terminating (SIGTERM) 01:47:38.931684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25677): Terminating (SIGTERM) 01:47:38.973992 --- ParallelTerminationStrategy: PID 25671 died... 01:47:38.994467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25671): Terminated: ok {rc=0} 01:47:39.040511 --- ParallelTerminationStrategy: PID 25674 died... 01:47:39.060381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25674): Terminated: ok {rc=0} 01:47:39.106211 --- ParallelTerminationStrategy: PID 25677 died... 01:47:39.126145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25677): Terminated: ok {rc=0} 01:47:39.214078 bus /sierra_3: Setting Powered False 01:47:40.312287 bus /sierra_3: Setting Powered False 01:47:41.428012 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 01:47:42.686969 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:47:42.695099 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 01:47:42.728085 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 01:47:42.756615 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 01:47:42.810485 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 01:47:42.844869 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 01:47:42.873358 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 01:47:43.419207 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 01:47:43.466986 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:43.478173 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:47:43.544777 tst mo_mt_call.py: using LAC 37699 01:47:43.662317 tst mo_mt_call.py: using RAC 214 01:47:43.781130 tst mo_mt_call.py: using CellId 37699 01:47:43.900740 tst mo_mt_call.py: using BVCI 37700 01:47:44.010420 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:44.021683 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:44.032594 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:44.043671 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:44.054695 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:44.065654 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:47:44.187035 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:47:44.306002 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:47:44.808389 run create_hlr_db(pid=25683): Launched 01:47:44.932181 bus /sierra_2: Setting Powered False 01:47:45.993717 run create_hlr_db(pid=25683): Terminated: ok {rc=0} 01:47:46.450590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25685): Launched 01:47:46.784198 run osmo-hlr_10.42.42.2(pid=25686): Launched 01:47:46.964794 run osmo-stp_10.42.42.5: Starting osmo-stp 01:47:47.574876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25688): Launched 01:47:47.878527 run osmo-stp_10.42.42.5(pid=25689): Launched 01:47:47.992359 run osmo-msc_10.42.42.6: Starting osmo-msc 01:47:48.537707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25691): Launched 01:47:48.843257 run osmo-msc_10.42.42.6(pid=25692): Launched 01:47:49.013238 run osmo-stp_10.42.42.5(pid=25689): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25689)] 01:47:49.140744 run osmo-stp_10.42.42.5(pid=25689): stdout: | (launched: 2022-12-14_01:47:47.821565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:49.267543 run osmo-stp_10.42.42.5(pid=25689): stderr: | [0;m[38;5;43m20221214014747994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014747994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014747994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014747995 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014747995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014747995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014747995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:49.392748 run osmo-stp_10.42.42.5(pid=25689): stdout: | (launched: 2022-12-14_01:47:47.821565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:49.511697 run osmo-stp_10.42.42.5(pid=25689): stderr: | [0;m[38;5;43m20221214014747994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014747994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014747994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014747995 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014747995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014747995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014747995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:49.654846 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25689): Process ended prematurely: osmo-stp_10.42.42.5(pid=25689) [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25689)] [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 01:47:49.663735 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 01:47:49.689869 run osmo-hlr_10.42.42.2(pid=25686): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25686)] 01:47:49.736536 run osmo-hlr_10.42.42.2(pid=25686): stdout: | (launched: 2022-12-14_01:47:46.719363) 01:47:49.784646 run osmo-hlr_10.42.42.2(pid=25686): stderr: | [0;m[1;31m20221214014747055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014747055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014747055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014747055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014747055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014747055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014747075 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014747091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014747092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014747092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:47:49.852301 run osmo-msc_10.42.42.6(pid=25692): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25692)] 01:47:49.898743 run osmo-msc_10.42.42.6(pid=25692): stdout: | (launched: 2022-12-14_01:47:48.786657) 01:47:49.946780 run osmo-msc_10.42.42.6(pid=25692): stderr: | [0;m[38;5;43m20221214014749058 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014749058 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0feae33c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014749058 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014749058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014749058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014749059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014749060 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014749061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014749061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014749061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:47:49.995025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25685): Terminating (SIGTERM) 01:47:50.034105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25688): Terminating (SIGTERM) 01:47:50.073168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25691): Terminating (SIGTERM) 01:47:50.112398 --- ParallelTerminationStrategy: PID 25685 died... 01:47:50.131346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25685): Terminated: ok {rc=0} 01:47:50.174647 --- ParallelTerminationStrategy: PID 25688 died... 01:47:50.193144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25688): Terminated: ok {rc=0} 01:47:50.236194 --- ParallelTerminationStrategy: PID 25691 died... 01:47:50.254561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25691): Terminated: ok {rc=0} 01:47:50.339269 bus /sierra_3: Setting Powered False 01:47:51.438315 bus /sierra_3: Setting Powered False 01:47:52.551468 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 01:47:53.695943 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:53.707851 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 01:47:53.775911 tst mo_mt_call_osmux.py: using LAC 37700 01:47:53.895553 tst mo_mt_call_osmux.py: using RAC 215 01:47:54.015073 tst mo_mt_call_osmux.py: using CellId 37700 01:47:54.134758 tst mo_mt_call_osmux.py: using BVCI 37701 01:47:54.245081 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:54.256275 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:54.267447 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:54.278516 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:54.289686 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 01:47:54.300650 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:47:54.416175 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 01:47:54.535823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:47:55.039308 run create_hlr_db(pid=25694): Launched 01:47:55.163910 bus /sierra_2: Setting Powered False 01:47:56.227545 run create_hlr_db(pid=25694): Terminated: ok {rc=0} 01:47:56.661255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25696): Launched 01:47:56.964412 run osmo-hlr_10.42.42.2(pid=25697): Launched 01:47:57.079393 run osmo-stp_10.42.42.5: Starting osmo-stp 01:47:57.604394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25699): Launched 01:47:57.907675 run osmo-stp_10.42.42.5(pid=25700): Launched 01:47:58.022788 run osmo-msc_10.42.42.6: Starting osmo-msc 01:47:58.570132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25702): Launched 01:47:58.874627 run osmo-msc_10.42.42.6(pid=25703): Launched 01:47:59.044081 run osmo-stp_10.42.42.5(pid=25700): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25700)] 01:47:59.171852 run osmo-stp_10.42.42.5(pid=25700): stdout: | (launched: 2022-12-14_01:47:57.851331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:59.298891 run osmo-stp_10.42.42.5(pid=25700): stderr: | [0;m[38;5;43m20221214014758021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014758021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014758021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014758022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014758022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014758022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014758023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:59.424127 run osmo-stp_10.42.42.5(pid=25700): stdout: | (launched: 2022-12-14_01:47:57.851331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:47:59.543617 run osmo-stp_10.42.42.5(pid=25700): stderr: | [0;m[38;5;43m20221214014758021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014758021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014758021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014758022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014758022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014758022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014758023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:47:59.687008 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25700): Process ended prematurely: osmo-stp_10.42.42.5(pid=25700) [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25700)] [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 01:47:59.695923 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 01:47:59.722768 run osmo-hlr_10.42.42.2(pid=25697): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25697)] 01:47:59.769747 run osmo-hlr_10.42.42.2(pid=25697): stdout: | (launched: 2022-12-14_01:47:56.908125) 01:47:59.818458 run osmo-hlr_10.42.42.2(pid=25697): stderr: | [0;m[1;31m20221214014757084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014757084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014757084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014757084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014757084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014757084 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014757096 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014757106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014757106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014757106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:47:59.886495 run osmo-msc_10.42.42.6(pid=25703): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25703)] 01:47:59.933594 run osmo-msc_10.42.42.6(pid=25703): stdout: | (launched: 2022-12-14_01:47:58.818043) 01:47:59.982017 run osmo-msc_10.42.42.6(pid=25703): stderr: | [0;m[38;5;43m20221214014759089 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014759089 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd60e33dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014759090 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014759090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014759090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014759090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014759092 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014759092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014759092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014759092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:48:00.030779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25696): Terminating (SIGTERM) 01:48:00.069754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25699): Terminating (SIGTERM) 01:48:00.108790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25702): Terminating (SIGTERM) 01:48:00.148031 --- ParallelTerminationStrategy: PID 25696 died... 01:48:00.167216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25696): Terminated: ok {rc=0} 01:48:00.210601 --- ParallelTerminationStrategy: PID 25699 died... 01:48:00.229269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25699): Terminated: ok {rc=0} 01:48:00.272170 --- ParallelTerminationStrategy: PID 25702 died... 01:48:00.290745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25702): Terminated: ok {rc=0} 01:48:00.375526 bus /sierra_3: Setting Powered False 01:48:01.471106 bus /sierra_3: Setting Powered False 01:48:02.584258 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 01:48:03.837342 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:48:03.845414 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 01:48:03.877084 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 01:48:03.903607 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 01:48:03.954979 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 01:48:03.987369 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 01:48:04.013915 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 01:48:04.565396 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 01:48:04.614703 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:04.626059 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:48:04.693398 tst mo_mt_call.py: using LAC 37701 01:48:04.812677 tst mo_mt_call.py: using RAC 216 01:48:04.932614 tst mo_mt_call.py: using CellId 37701 01:48:05.062810 tst mo_mt_call.py: using BVCI 37702 01:48:05.182271 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:05.194223 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:05.205963 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:05.217667 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:05.229537 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:05.241438 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:48:05.363131 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:48:05.483927 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:48:05.987705 run create_hlr_db(pid=25708): Launched 01:48:06.112506 bus /sierra_2: Setting Powered False 01:48:07.177103 run create_hlr_db(pid=25708): Terminated: ok {rc=0} 01:48:07.631120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25710): Launched 01:48:07.958993 run osmo-hlr_10.42.42.2(pid=25711): Launched 01:48:08.084906 run osmo-stp_10.42.42.5: Starting osmo-stp 01:48:08.641921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25713): Launched 01:48:08.969460 run osmo-stp_10.42.42.5(pid=25714): Launched 01:48:09.095634 run osmo-msc_10.42.42.6: Starting osmo-msc 01:48:09.684032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25716): Launched 01:48:10.013076 run osmo-msc_10.42.42.6(pid=25717): Launched 01:48:10.193209 run osmo-stp_10.42.42.5(pid=25714): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25714)] 01:48:10.329942 run osmo-stp_10.42.42.5(pid=25714): stdout: | (launched: 2022-12-14_01:48:08.908613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:10.467018 run osmo-stp_10.42.42.5(pid=25714): stderr: | [0;m[38;5;43m20221214014809100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014809100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014809101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014809101 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014809102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014809102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014809102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:10.602870 run osmo-stp_10.42.42.5(pid=25714): stdout: | (launched: 2022-12-14_01:48:08.908613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:10.732166 run osmo-stp_10.42.42.5(pid=25714): stderr: | [0;m[38;5;43m20221214014809100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014809100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014809101 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014809101 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014809102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014809102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014809102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:10.887321 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25714): Process ended prematurely: osmo-stp_10.42.42.5(pid=25714) [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25714)] [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 01:48:10.897148 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 01:48:10.925393 run osmo-hlr_10.42.42.2(pid=25711): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25711)] 01:48:10.976074 run osmo-hlr_10.42.42.2(pid=25711): stdout: | (launched: 2022-12-14_01:48:07.898323) 01:48:11.027577 run osmo-hlr_10.42.42.2(pid=25711): stderr: | [0;m[1;31m20221214014808094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014808094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014808094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014808094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014808094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014808094 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014808107 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014808115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014808116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014808116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:48:11.099558 run osmo-msc_10.42.42.6(pid=25717): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25717)] 01:48:11.148869 run osmo-msc_10.42.42.6(pid=25717): stdout: | (launched: 2022-12-14_01:48:09.951856) 01:48:11.201207 run osmo-msc_10.42.42.6(pid=25717): stderr: | [0;m[38;5;43m20221214014810273 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014810273 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcb24262c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014810273 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014810273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014810273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014810274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014810275 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014810276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014810276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014810276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:48:11.252810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25710): Terminating (SIGTERM) 01:48:11.294300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25713): Terminating (SIGTERM) 01:48:11.336255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25716): Terminating (SIGTERM) 01:48:11.378261 --- ParallelTerminationStrategy: PID 25710 died... 01:48:11.398657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25710): Terminated: ok {rc=0} 01:48:11.444678 --- ParallelTerminationStrategy: PID 25713 died... 01:48:11.464470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25713): Terminated: ok {rc=0} 01:48:11.510391 --- ParallelTerminationStrategy: PID 25716 died... 01:48:11.530313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25716): Terminated: ok {rc=0} 01:48:11.618253 bus /sierra_3: Setting Powered False 01:48:12.714979 bus /sierra_3: Setting Powered False 01:48:13.830258 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 01:48:14.978118 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:14.990888 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 01:48:15.060751 tst mo_mt_call_osmux.py: using LAC 37702 01:48:15.188319 tst mo_mt_call_osmux.py: using RAC 217 01:48:15.315715 tst mo_mt_call_osmux.py: using CellId 37702 01:48:15.442345 tst mo_mt_call_osmux.py: using BVCI 37703 01:48:15.559996 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:15.571842 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:15.583370 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:15.595030 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:15.606952 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 01:48:15.618903 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:48:15.736618 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 01:48:15.885733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:48:16.414468 run create_hlr_db(pid=25719): Launched 01:48:16.573495 bus /sierra_2: Setting Powered False 01:48:17.634274 run create_hlr_db(pid=25719): Terminated: ok {rc=0} 01:48:18.096105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25721): Launched 01:48:18.423569 run osmo-hlr_10.42.42.2(pid=25722): Launched 01:48:18.547402 run osmo-stp_10.42.42.5: Starting osmo-stp 01:48:19.110538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25724): Launched 01:48:19.437086 run osmo-stp_10.42.42.5(pid=25725): Launched 01:48:19.561587 run osmo-msc_10.42.42.6: Starting osmo-msc 01:48:20.147809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25727): Launched 01:48:20.474877 run osmo-msc_10.42.42.6(pid=25728): Launched 01:48:20.656417 run osmo-stp_10.42.42.5(pid=25725): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25725)] 01:48:20.793610 run osmo-stp_10.42.42.5(pid=25725): stdout: | (launched: 2022-12-14_01:48:19.377079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:20.931622 run osmo-stp_10.42.42.5(pid=25725): stderr: | [0;m[38;5;43m20221214014819568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014819568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014819568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014819569 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014819569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014819569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014819569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:21.067036 run osmo-stp_10.42.42.5(pid=25725): stdout: | (launched: 2022-12-14_01:48:19.377079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:21.195475 run osmo-stp_10.42.42.5(pid=25725): stderr: | [0;m[38;5;43m20221214014819568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014819568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014819568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014819569 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014819569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014819569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014819569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:21.349830 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25725): Process ended prematurely: osmo-stp_10.42.42.5(pid=25725) [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25725)] [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 01:48:21.359802 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 01:48:21.387599 run osmo-hlr_10.42.42.2(pid=25722): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25722)] 01:48:21.437597 run osmo-hlr_10.42.42.2(pid=25722): stdout: | (launched: 2022-12-14_01:48:18.362303) 01:48:21.488792 run osmo-hlr_10.42.42.2(pid=25722): stderr: | [0;m[1;31m20221214014818560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014818560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014818560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014818560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014818560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014818560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014818573 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014818581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014818581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014818582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:48:21.560842 run osmo-msc_10.42.42.6(pid=25728): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25728)] 01:48:21.609995 run osmo-msc_10.42.42.6(pid=25728): stdout: | (launched: 2022-12-14_01:48:20.414782) 01:48:21.661120 run osmo-msc_10.42.42.6(pid=25728): stderr: | [0;m[38;5;43m20221214014820736 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014820736 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb449586c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014820736 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014820736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014820736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014820736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014820738 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014820738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014820739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014820739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:48:21.712268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25721): Terminating (SIGTERM) 01:48:21.754072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25724): Terminating (SIGTERM) 01:48:21.795786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25727): Terminating (SIGTERM) 01:48:21.837912 --- ParallelTerminationStrategy: PID 25721 died... 01:48:21.858259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25721): Terminated: ok {rc=0} 01:48:21.904158 --- ParallelTerminationStrategy: PID 25724 died... 01:48:21.924039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25724): Terminated: ok {rc=0} 01:48:21.970000 --- ParallelTerminationStrategy: PID 25727 died... 01:48:21.989663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25727): Terminated: ok {rc=0} 01:48:22.077419 bus /sierra_3: Setting Powered False 01:48:23.175048 bus /sierra_3: Setting Powered False 01:48:24.290558 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 01:48:25.546404 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:48:25.554287 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 01:48:25.586151 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 01:48:25.613205 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 01:48:25.665717 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 01:48:25.698764 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 01:48:25.726241 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 01:48:26.278088 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 01:48:26.326192 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:26.337824 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:48:26.403231 tst mo_mt_call.py: using LAC 37703 01:48:26.520077 tst mo_mt_call.py: using RAC 218 01:48:26.636422 tst mo_mt_call.py: using CellId 37703 01:48:26.756008 tst mo_mt_call.py: using BVCI 37704 01:48:26.866345 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:26.877788 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:26.888844 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:26.900003 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:26.910961 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:26.922174 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:48:27.042983 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:48:27.160758 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:48:27.664695 run create_hlr_db(pid=25733): Launched 01:48:27.787886 bus /sierra_2: Setting Powered False 01:48:28.851188 run create_hlr_db(pid=25733): Terminated: ok {rc=0} 01:48:29.303151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25735): Launched 01:48:29.630065 run osmo-hlr_10.42.42.2(pid=25736): Launched 01:48:29.755072 run osmo-stp_10.42.42.5: Starting osmo-stp 01:48:30.315178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25738): Launched 01:48:30.641681 run osmo-stp_10.42.42.5(pid=25739): Launched 01:48:30.767738 run osmo-msc_10.42.42.6: Starting osmo-msc 01:48:31.498331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25741): Launched 01:48:31.837559 run osmo-msc_10.42.42.6(pid=25742): Launched 01:48:32.246250 run osmo-stp_10.42.42.5(pid=25739): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25739)] 01:48:32.382352 run osmo-stp_10.42.42.5(pid=25739): stdout: | (launched: 2022-12-14_01:48:30.581593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:32.508379 run osmo-stp_10.42.42.5(pid=25739): stderr: | [0;m[38;5;43m20221214014830774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014830774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014830774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014830774 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014830775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014830775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014830775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:32.634708 run osmo-stp_10.42.42.5(pid=25739): stdout: | (launched: 2022-12-14_01:48:30.581593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:32.754577 run osmo-stp_10.42.42.5(pid=25739): stderr: | [0;m[38;5;43m20221214014830774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014830774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014830774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014830774 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014830775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014830775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014830775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:32.898320 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25739): Process ended prematurely: osmo-stp_10.42.42.5(pid=25739) [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25739)] [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 01:48:32.907557 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 01:48:32.934271 run osmo-hlr_10.42.42.2(pid=25736): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25736)] 01:48:32.981641 run osmo-hlr_10.42.42.2(pid=25736): stdout: | (launched: 2022-12-14_01:48:29.569697) 01:48:33.030420 run osmo-hlr_10.42.42.2(pid=25736): stderr: | [0;m[1;31m20221214014829766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014829766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014829766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014829766 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014829767 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014829767 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014829780 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014829788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014829788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014829788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:48:33.098991 run osmo-msc_10.42.42.6(pid=25742): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25742)] 01:48:33.145793 run osmo-msc_10.42.42.6(pid=25742): stdout: | (launched: 2022-12-14_01:48:31.777642) 01:48:33.194677 run osmo-msc_10.42.42.6(pid=25742): stderr: | [0;m[38;5;43m20221214014832131 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014832131 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe7b01f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014832131 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014832131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014832132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014832133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014832135 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014832135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014832135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014832135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:48:33.244016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25735): Terminating (SIGTERM) 01:48:33.283164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25738): Terminating (SIGTERM) 01:48:33.322312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25741): Terminating (SIGTERM) 01:48:33.362558 --- ParallelTerminationStrategy: PID 25735 died... 01:48:33.382105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25735): Terminated: ok {rc=0} 01:48:33.425724 --- ParallelTerminationStrategy: PID 25738 died... 01:48:33.444696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25738): Terminated: ok {rc=0} 01:48:33.488285 --- ParallelTerminationStrategy: PID 25741 died... 01:48:33.507021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25741): Terminated: ok {rc=0} 01:48:33.591843 bus /sierra_3: Setting Powered False 01:48:34.689673 bus /sierra_3: Setting Powered False 01:48:35.801446 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 01:48:36.950083 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:36.962660 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 01:48:37.031218 tst mo_mt_call_osmux.py: using LAC 37704 01:48:37.161565 tst mo_mt_call_osmux.py: using RAC 219 01:48:37.287930 tst mo_mt_call_osmux.py: using CellId 37704 01:48:37.407184 tst mo_mt_call_osmux.py: using BVCI 37705 01:48:37.518184 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:37.529497 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:37.540670 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:37.551597 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:37.562636 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 01:48:37.573603 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:48:37.694192 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 01:48:37.815321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:48:38.319799 run create_hlr_db(pid=25744): Launched 01:48:38.445491 bus /sierra_2: Setting Powered False 01:48:39.509176 run create_hlr_db(pid=25744): Terminated: ok {rc=0} 01:48:39.942905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25746): Launched 01:48:40.251410 run osmo-hlr_10.42.42.2(pid=25747): Launched 01:48:40.368805 run osmo-stp_10.42.42.5: Starting osmo-stp 01:48:40.891483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25749): Launched 01:48:41.195586 run osmo-stp_10.42.42.5(pid=25750): Launched 01:48:41.311200 run osmo-msc_10.42.42.6: Starting osmo-msc 01:48:41.859437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25752): Launched 01:48:42.163731 run osmo-msc_10.42.42.6(pid=25753): Launched 01:48:42.333749 run osmo-stp_10.42.42.5(pid=25750): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25750)] 01:48:42.461189 run osmo-stp_10.42.42.5(pid=25750): stdout: | (launched: 2022-12-14_01:48:41.139117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:42.588463 run osmo-stp_10.42.42.5(pid=25750): stderr: | [0;m[38;5;43m20221214014841306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014841306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014841306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014841307 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014841307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014841307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014841307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:42.714224 run osmo-stp_10.42.42.5(pid=25750): stdout: | (launched: 2022-12-14_01:48:41.139117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:42.834904 run osmo-stp_10.42.42.5(pid=25750): stderr: | [0;m[38;5;43m20221214014841306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014841306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014841306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014841307 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014841307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014841307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014841307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:42.978862 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25750): Process ended prematurely: osmo-stp_10.42.42.5(pid=25750) [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25750)] [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 01:48:42.987942 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:48:43.014389 run osmo-hlr_10.42.42.2(pid=25747): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25747)] 01:48:43.061107 run osmo-hlr_10.42.42.2(pid=25747): stdout: | (launched: 2022-12-14_01:48:40.195083) 01:48:43.109301 run osmo-hlr_10.42.42.2(pid=25747): stderr: | [0;m[1;31m20221214014840368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014840368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014840368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014840368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014840368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014840368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014840380 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014840388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014840388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014840388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:48:43.177242 run osmo-msc_10.42.42.6(pid=25753): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25753)] 01:48:43.223550 run osmo-msc_10.42.42.6(pid=25753): stdout: | (launched: 2022-12-14_01:48:42.107352) 01:48:43.271590 run osmo-msc_10.42.42.6(pid=25753): stderr: | [0;m[38;5;43m20221214014842378 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014842378 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f370eeddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014842378 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014842378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014842378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014842379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014842380 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014842381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014842381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014842381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:48:43.319907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25746): Terminating (SIGTERM) 01:48:43.358950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25749): Terminating (SIGTERM) 01:48:43.397971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25752): Terminating (SIGTERM) 01:48:43.437695 --- ParallelTerminationStrategy: PID 25746 died... 01:48:43.456402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25746): Terminated: ok {rc=0} 01:48:43.499982 --- ParallelTerminationStrategy: PID 25749 died... 01:48:43.518568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25749): Terminated: ok {rc=0} 01:48:43.561620 --- ParallelTerminationStrategy: PID 25752 died... 01:48:43.579911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25752): Terminated: ok {rc=0} 01:48:43.662240 bus /sierra_3: Setting Powered False 01:48:44.757053 bus /sierra_3: Setting Powered False 01:48:45.892698 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 01:48:47.154316 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:48:47.175173 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:48:47.209492 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 01:48:47.237787 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:48:47.289814 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:48:47.322842 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 01:48:47.349710 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:48:47.901902 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 01:48:47.951115 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:47.962490 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:48:48.032049 tst mo_mt_call.py: using LAC 37705 01:48:48.150497 tst mo_mt_call.py: using RAC 220 01:48:48.268805 tst mo_mt_call.py: using CellId 37705 01:48:48.385971 tst mo_mt_call.py: using BVCI 37706 01:48:48.495365 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:48.506620 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:48.517683 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:48.528723 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:48.540463 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:48.552006 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:48:48.672120 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:48:48.798723 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:48:49.301400 run create_hlr_db(pid=25760): Launched 01:48:49.427456 bus /sierra_2: Setting Powered False 01:48:50.491533 run create_hlr_db(pid=25760): Terminated: ok {rc=0} 01:48:50.923888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25762): Launched 01:48:51.227937 run osmo-hlr_10.42.42.2(pid=25763): Launched 01:48:51.343437 run osmo-stp_10.42.42.5: Starting osmo-stp 01:48:51.866952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25765): Launched 01:48:52.169368 run osmo-stp_10.42.42.5(pid=25766): Launched 01:48:52.284317 run osmo-msc_10.42.42.6: Starting osmo-msc 01:48:52.832848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25768): Launched 01:48:53.136497 run osmo-msc_10.42.42.6(pid=25769): Launched 01:48:53.304305 run osmo-stp_10.42.42.5(pid=25766): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25766)] 01:48:53.431247 run osmo-stp_10.42.42.5(pid=25766): stdout: | (launched: 2022-12-14_01:48:52.112805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:53.559152 run osmo-stp_10.42.42.5(pid=25766): stderr: | [0;m[38;5;43m20221214014852279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014852279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014852279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014852280 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014852280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014852280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014852280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:53.684636 run osmo-stp_10.42.42.5(pid=25766): stdout: | (launched: 2022-12-14_01:48:52.112805) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:48:53.803551 run osmo-stp_10.42.42.5(pid=25766): stderr: | [0;m[38;5;43m20221214014852279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014852279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014852279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014852280 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014852280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014852280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014852280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:48:53.946558 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25766): Process ended prematurely: osmo-stp_10.42.42.5(pid=25766) [trial-2397↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25766)] [trial-2397↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 01:48:53.955505 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 01:48:53.981704 run osmo-hlr_10.42.42.2(pid=25763): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25763)] 01:48:54.028896 run osmo-hlr_10.42.42.2(pid=25763): stdout: | (launched: 2022-12-14_01:48:51.171773) 01:48:54.077308 run osmo-hlr_10.42.42.2(pid=25763): stderr: | [0;m[1;31m20221214014851342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014851342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014851342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014851342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014851343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014851343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014851355 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014851365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014851365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014851365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:48:54.145148 run osmo-msc_10.42.42.6(pid=25769): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25769)] 01:48:54.191878 run osmo-msc_10.42.42.6(pid=25769): stdout: | (launched: 2022-12-14_01:48:53.080010) 01:48:54.240053 run osmo-msc_10.42.42.6(pid=25769): stderr: | [0;m[38;5;43m20221214014853349 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014853349 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5b9910ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014853349 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014853350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014853350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014853350 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014853352 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014853352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014853352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014853352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:48:54.288681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25762): Terminating (SIGTERM) 01:48:54.327879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25765): Terminating (SIGTERM) 01:48:54.367170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25768): Terminating (SIGTERM) 01:48:54.406576 --- ParallelTerminationStrategy: PID 25762 died... 01:48:54.425489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25762): Terminated: ok {rc=0} 01:48:54.468592 --- ParallelTerminationStrategy: PID 25765 died... 01:48:54.487155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25765): Terminated: ok {rc=0} 01:48:54.530238 --- ParallelTerminationStrategy: PID 25768 died... 01:48:54.548526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25768): Terminated: ok {rc=0} 01:48:54.630713 bus /sierra_3: Setting Powered False 01:48:55.727841 bus /sierra_3: Setting Powered False 01:48:56.843333 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 01:48:57.991890 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:58.004408 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:48:58.074331 tst mo_mt_call_osmux.py: using LAC 37706 01:48:58.202754 tst mo_mt_call_osmux.py: using RAC 221 01:48:58.330727 tst mo_mt_call_osmux.py: using CellId 37706 01:48:58.457155 tst mo_mt_call_osmux.py: using BVCI 37707 01:48:58.575762 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:58.587553 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:58.599149 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:58.610777 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:58.622750 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 01:48:58.634769 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:48:58.751939 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:48:58.871770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:48:59.375119 run create_hlr_db(pid=25771): Launched 01:48:59.498623 bus /sierra_2: Setting Powered False 01:49:00.562562 run create_hlr_db(pid=25771): Terminated: ok {rc=0} 01:49:01.036170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25773): Launched 01:49:01.361260 run osmo-hlr_10.42.42.2(pid=25774): Launched 01:49:01.534173 run osmo-stp_10.42.42.5: Starting osmo-stp 01:49:02.201500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25776): Launched 01:49:02.534807 run osmo-stp_10.42.42.5(pid=25777): Launched 01:49:02.660299 run osmo-msc_10.42.42.6: Starting osmo-msc 01:49:03.247491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25779): Launched 01:49:03.574010 run osmo-msc_10.42.42.6(pid=25780): Launched 01:49:03.755783 run osmo-stp_10.42.42.5(pid=25777): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25777)] 01:49:03.892121 run osmo-stp_10.42.42.5(pid=25777): stdout: | (launched: 2022-12-14_01:49:02.474897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:04.029585 run osmo-stp_10.42.42.5(pid=25777): stderr: | [0;m[38;5;43m20221214014902664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014902664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014902664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014902665 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014902665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014902665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014902665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:04.164702 run osmo-stp_10.42.42.5(pid=25777): stdout: | (launched: 2022-12-14_01:49:02.474897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:04.293412 run osmo-stp_10.42.42.5(pid=25777): stderr: | [0;m[38;5;43m20221214014902664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014902664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014902664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014902665 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014902665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014902665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014902665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:04.447891 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25777): Process ended prematurely: osmo-stp_10.42.42.5(pid=25777) [trial-2397↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25777)] [trial-2397↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 01:49:04.457596 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 01:49:04.485186 run osmo-hlr_10.42.42.2(pid=25774): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25774)] 01:49:04.535148 run osmo-hlr_10.42.42.2(pid=25774): stdout: | (launched: 2022-12-14_01:49:01.300140) 01:49:04.586518 run osmo-hlr_10.42.42.2(pid=25774): stderr: | [0;m[1;31m20221214014901694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014901694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014901694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014901694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014901694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014901694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014901714 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014901734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014901735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014901735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:49:04.658616 run osmo-msc_10.42.42.6(pid=25780): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25780)] 01:49:04.707822 run osmo-msc_10.42.42.6(pid=25780): stdout: | (launched: 2022-12-14_01:49:03.513669) 01:49:04.759135 run osmo-msc_10.42.42.6(pid=25780): stderr: | [0;m[38;5;43m20221214014903834 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014903835 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc026fffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014903835 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014903835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014903835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014903835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014903837 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014903837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014903837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014903837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:49:04.810581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25773): Terminating (SIGTERM) 01:49:04.851993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25776): Terminating (SIGTERM) 01:49:04.893532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25779): Terminating (SIGTERM) 01:49:04.935834 --- ParallelTerminationStrategy: PID 25773 died... 01:49:04.956240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25773): Terminated: ok {rc=0} 01:49:05.002042 --- ParallelTerminationStrategy: PID 25776 died... 01:49:05.021774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25776): Terminated: ok {rc=0} 01:49:05.067393 --- ParallelTerminationStrategy: PID 25779 died... 01:49:05.087096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25779): Terminated: ok {rc=0} 01:49:05.174657 bus /sierra_3: Setting Powered False 01:49:06.273320 bus /sierra_3: Setting Powered False 01:49:07.389768 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 01:49:08.642645 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:49:08.650330 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 01:49:08.683213 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 01:49:08.711065 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 01:49:08.764671 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 01:49:08.797839 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 01:49:08.825524 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 01:49:09.377165 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 01:49:09.431061 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:09.442974 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:49:09.494191 tst mo_mt_call.py: using LAC 37707 01:49:09.613513 tst mo_mt_call.py: using RAC 222 01:49:09.732370 tst mo_mt_call.py: using CellId 37707 01:49:09.853301 tst mo_mt_call.py: using BVCI 37708 01:49:09.962592 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:09.974030 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:09.985194 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:09.996300 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:10.007529 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:10.018775 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:49:10.138069 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:49:10.257302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:49:10.728877 run create_hlr_db(pid=25786): Launched 01:49:10.853709 bus /sierra_2: Setting Powered False 01:49:11.915572 run create_hlr_db(pid=25786): Terminated: ok {rc=0} 01:49:12.339374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25788): Launched 01:49:12.642959 run osmo-hlr_10.42.42.2(pid=25789): Launched 01:49:12.757225 run osmo-stp_10.42.42.5: Starting osmo-stp 01:49:13.282466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25791): Launched 01:49:13.584483 run osmo-stp_10.42.42.5(pid=25792): Launched 01:49:13.699019 run osmo-msc_10.42.42.6: Starting osmo-msc 01:49:14.245476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25794): Launched 01:49:14.550163 run osmo-msc_10.42.42.6(pid=25795): Launched 01:49:14.720127 run osmo-stp_10.42.42.5(pid=25792): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25792)] 01:49:14.846998 run osmo-stp_10.42.42.5(pid=25792): stdout: | (launched: 2022-12-14_01:49:13.528264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:14.973616 run osmo-stp_10.42.42.5(pid=25792): stderr: | [0;m[38;5;43m20221214014913696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014913696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014913696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014913696 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014913697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014913697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014913697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:15.098325 run osmo-stp_10.42.42.5(pid=25792): stdout: | (launched: 2022-12-14_01:49:13.528264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:15.217893 run osmo-stp_10.42.42.5(pid=25792): stderr: | [0;m[38;5;43m20221214014913696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014913696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014913696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014913696 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014913697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014913697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014913697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:15.360674 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25792): Process ended prematurely: osmo-stp_10.42.42.5(pid=25792) [trial-2397↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25792)] [trial-2397↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 01:49:15.369603 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 01:49:15.395910 run osmo-hlr_10.42.42.2(pid=25789): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25789)] 01:49:15.442963 run osmo-hlr_10.42.42.2(pid=25789): stdout: | (launched: 2022-12-14_01:49:12.586323) 01:49:15.491912 run osmo-hlr_10.42.42.2(pid=25789): stderr: | [0;m[1;31m20221214014912758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014912758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014912758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014912758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014912758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014912758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014912770 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014912782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014912782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014912782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:49:15.560114 run osmo-msc_10.42.42.6(pid=25795): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25795)] 01:49:15.607029 run osmo-msc_10.42.42.6(pid=25795): stdout: | (launched: 2022-12-14_01:49:14.492872) 01:49:15.655510 run osmo-msc_10.42.42.6(pid=25795): stderr: | [0;m[38;5;43m20221214014914765 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014914765 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3fd9a3ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014914765 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014914765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014914765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014914765 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014914767 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014914767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014914768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014914768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:49:15.705083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25788): Terminating (SIGTERM) 01:49:15.744317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25791): Terminating (SIGTERM) 01:49:15.783436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25794): Terminating (SIGTERM) 01:49:15.822942 --- ParallelTerminationStrategy: PID 25788 died... 01:49:15.852198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25788): Terminated: ok {rc=0} 01:49:15.905783 --- ParallelTerminationStrategy: PID 25791 died... 01:49:15.933981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25791): Terminated: ok {rc=0} 01:49:15.987095 --- ParallelTerminationStrategy: PID 25794 died... 01:49:16.008293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25794): Terminated: ok {rc=0} 01:49:16.098364 bus /sierra_3: Setting Powered False 01:49:17.193408 bus /sierra_3: Setting Powered False 01:49:18.305880 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 01:49:19.454277 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:19.467090 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:49:19.519803 tst mo_mt_call_osmux.py: using LAC 37708 01:49:19.648670 tst mo_mt_call_osmux.py: using RAC 223 01:49:19.777662 tst mo_mt_call_osmux.py: using CellId 37708 01:49:19.905595 tst mo_mt_call_osmux.py: using BVCI 37709 01:49:20.018574 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:20.030687 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:20.042642 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:20.054563 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:20.066426 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 01:49:20.077769 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:49:20.199397 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 01:49:20.316851 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:49:20.819634 run create_hlr_db(pid=25797): Launched 01:49:20.945482 bus /sierra_2: Setting Powered False 01:49:22.009930 run create_hlr_db(pid=25797): Terminated: ok {rc=0} 01:49:22.445506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25799): Launched 01:49:22.750658 run osmo-hlr_10.42.42.2(pid=25800): Launched 01:49:22.865873 run osmo-stp_10.42.42.5: Starting osmo-stp 01:49:23.409454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25802): Launched 01:49:23.714462 run osmo-stp_10.42.42.5(pid=25803): Launched 01:49:23.832086 run osmo-msc_10.42.42.6: Starting osmo-msc 01:49:24.380714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25805): Launched 01:49:24.687998 run osmo-msc_10.42.42.6(pid=25806): Launched 01:49:24.858336 run osmo-stp_10.42.42.5(pid=25803): ERR: Terminated: ERROR {rc=1} [trial-2397↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25803)] 01:49:24.986083 run osmo-stp_10.42.42.5(pid=25803): stdout: | (launched: 2022-12-14_01:49:23.657663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:25.114051 run osmo-stp_10.42.42.5(pid=25803): stderr: | [0;m[38;5;43m20221214014923827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014923828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014923828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014923828 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014923829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014923829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014923829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:25.240283 run osmo-stp_10.42.42.5(pid=25803): stdout: | (launched: 2022-12-14_01:49:23.657663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:25.360072 run osmo-stp_10.42.42.5(pid=25803): stderr: | [0;m[38;5;43m20221214014923827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014923828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014923828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014923828 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014923829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014923829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014923829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:25.503851 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25803): Process ended prematurely: osmo-stp_10.42.42.5(pid=25803) [trial-2397↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25803)] [trial-2397↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 01:49:25.512858 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 01:49:25.539341 run osmo-hlr_10.42.42.2(pid=25800): ERR: Terminated: ERROR {rc=237} [trial-2397↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25800)] 01:49:25.586379 run osmo-hlr_10.42.42.2(pid=25800): stdout: | (launched: 2022-12-14_01:49:22.693921) 01:49:25.635022 run osmo-hlr_10.42.42.2(pid=25800): stderr: | [0;m[1;31m20221214014922868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014922868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014922868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014922868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014922868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014922868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014922880 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014922889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014922889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014922889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:49:25.703724 run osmo-msc_10.42.42.6(pid=25806): ERR: Terminated: ERROR {rc=2} [trial-2397↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25806)] 01:49:25.751249 run osmo-msc_10.42.42.6(pid=25806): stdout: | (launched: 2022-12-14_01:49:24.630972) 01:49:25.800372 run osmo-msc_10.42.42.6(pid=25806): stderr: | [0;m[38;5;43m20221214014924899 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014924899 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4e43d98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014924899 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014924899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014924899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014924900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014924901 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014924902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014924902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014924902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:49:25.849492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25799): Terminating (SIGTERM) 01:49:25.888785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25802): Terminating (SIGTERM) 01:49:25.928015 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25805): Terminating (SIGTERM) 01:49:25.967550 --- ParallelTerminationStrategy: PID 25799 died... 01:49:25.986548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25799): Terminated: ok {rc=0} 01:49:26.029996 --- ParallelTerminationStrategy: PID 25802 died... 01:49:26.048362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25802): Terminated: ok {rc=0} 01:49:26.092199 --- ParallelTerminationStrategy: PID 25805 died... 01:49:26.110787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25805): Terminated: ok {rc=0} 01:49:26.195921 bus /sierra_3: Setting Powered False 01:49:27.295428 bus /sierra_3: Setting Powered False 01:49:28.410476 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 emergency:nanobts+band-900 --------------------------------------------------------------------- 01:49:29.667685 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:49:29.673395 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 01:49:29.705342 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 01:49:29.732028 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 01:49:29.815238 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 01:49:29.847181 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 01:49:29.873198 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 01:49:30.459009 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2397 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 01:49:30.463939 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:30.474649 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 01:49:30.522390 tst emergency_mo_mt_call.py: using LAC 37709 01:49:30.640083 tst emergency_mo_mt_call.py: using RAC 224 01:49:30.756223 tst emergency_mo_mt_call.py: using CellId 37709 01:49:30.886343 tst emergency_mo_mt_call.py: using BVCI 37710 01:49:31.023369 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:31.035842 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:31.048099 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:31.060381 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:31.073888 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:31.087298 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:31.212623 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:31.350824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:49:31.875154 run create_hlr_db(pid=25811): Launched 01:49:32.032734 bus /sierra_2: Setting Powered False 01:49:33.095912 run create_hlr_db(pid=25811): Terminated: ok {rc=0} 01:49:33.526751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25813): Launched 01:49:33.824286 run osmo-hlr_10.42.42.2(pid=25814): Launched 01:49:33.936666 run osmo-stp_10.42.42.5: Starting osmo-stp 01:49:34.447128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25816): Launched 01:49:34.745050 run osmo-stp_10.42.42.5(pid=25817): Launched 01:49:34.867264 tst emergency_mo_mt_call.py: using MSISDN 8436 01:49:35.017793 run osmo-msc_10.42.42.6: Starting osmo-msc 01:49:35.554252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25819): Launched 01:49:35.853753 run osmo-msc_10.42.42.6(pid=25820): Launched 01:49:36.020412 run osmo-stp_10.42.42.5(pid=25817): ERR: Terminated: ERROR {rc=1} [trial-2397↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25817)] 01:49:36.146678 run osmo-stp_10.42.42.5(pid=25817): stdout: | (launched: 2022-12-14_01:49:34.688740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:36.271971 run osmo-stp_10.42.42.5(pid=25817): stderr: | [0;m[38;5;43m20221214014934858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014934858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014934860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014934860 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014934861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014934861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014934861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:36.395601 run osmo-stp_10.42.42.5(pid=25817): stdout: | (launched: 2022-12-14_01:49:34.688740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:36.514028 run osmo-stp_10.42.42.5(pid=25817): stderr: | [0;m[38;5;43m20221214014934858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014934858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014934860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014934860 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014934861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014934861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014934861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:36.655448 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=25817): Process ended prematurely: osmo-stp_10.42.42.5(pid=25817) [trial-2397↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25817)] [trial-2397↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 01:49:36.663790 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 01:49:36.689726 run osmo-hlr_10.42.42.2(pid=25814): ERR: Terminated: ERROR {rc=237} [trial-2397↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25814)] 01:49:36.736869 run osmo-hlr_10.42.42.2(pid=25814): stdout: | (launched: 2022-12-14_01:49:33.768899) 01:49:36.786088 run osmo-hlr_10.42.42.2(pid=25814): stderr: | [0;m[1;31m20221214014933942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014933942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014933942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014933942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014933942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014933943 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014933955 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014933964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014933964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014933964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:49:36.854623 run osmo-msc_10.42.42.6(pid=25820): ERR: Terminated: ERROR {rc=2} [trial-2397↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25820)] 01:49:36.901927 run osmo-msc_10.42.42.6(pid=25820): stdout: | (launched: 2022-12-14_01:49:35.798129) 01:49:36.950829 run osmo-msc_10.42.42.6(pid=25820): stderr: | [0;m[38;5;43m20221214014936067 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014936067 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0c0ed52c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014936067 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014936067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014936068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014936068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014936070 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014936070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014936070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014936070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:49:36.999970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25813): Terminating (SIGTERM) 01:49:37.039253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25816): Terminating (SIGTERM) 01:49:37.078132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25819): Terminating (SIGTERM) 01:49:37.117690 --- ParallelTerminationStrategy: PID 25813 died... 01:49:37.136575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25813): Terminated: ok {rc=0} 01:49:37.180263 --- ParallelTerminationStrategy: PID 25816 died... 01:49:37.198709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25816): Terminated: ok {rc=0} 01:49:37.242157 --- ParallelTerminationStrategy: PID 25819 died... 01:49:37.260660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25819): Terminated: ok {rc=0} 01:49:37.346250 bus /sierra_3: Setting Powered False 01:49:38.446267 bus /sierra_3: Setting Powered False 01:49:39.560979 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 01:49:40.646268 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:40.657849 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 01:49:40.708523 tst emergency_preemptive_call.py: using LAC 37710 01:49:40.835212 tst emergency_preemptive_call.py: using RAC 225 01:49:40.960806 tst emergency_preemptive_call.py: using CellId 37710 01:49:41.088161 tst emergency_preemptive_call.py: using BVCI 37711 01:49:41.205833 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:41.217255 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:41.228455 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:41.239776 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:41.251655 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 01:49:41.263492 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:41.385473 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:41.500035 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:41.618328 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:41.735518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:49:42.232833 run create_hlr_db(pid=25823): Launched 01:49:42.355891 bus /sierra_2: Setting Powered False 01:49:43.419889 run create_hlr_db(pid=25823): Terminated: ok {rc=0} 01:49:43.848712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25825): Launched 01:49:44.148167 run osmo-hlr_10.42.42.2(pid=25826): Launched 01:49:44.260413 run osmo-stp_10.42.42.5: Starting osmo-stp 01:49:44.773305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25828): Launched 01:49:45.070594 run osmo-stp_10.42.42.5(pid=25829): Launched 01:49:45.195317 tst emergency_preemptive_call.py: using MSISDN 8437 01:49:45.346633 run osmo-msc_10.42.42.6: Starting osmo-msc 01:49:45.917768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25831): Launched 01:49:46.270430 run osmo-msc_10.42.42.6(pid=25832): Launched 01:49:46.667059 run osmo-stp_10.42.42.5(pid=25829): ERR: Terminated: ERROR {rc=1} [trial-2397↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25829)] 01:49:46.984254 run osmo-stp_10.42.42.5(pid=25829): stdout: | (launched: 2022-12-14_01:49:45.014811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:47.154494 run osmo-stp_10.42.42.5(pid=25829): stderr: | [0;m[38;5;43m20221214014945183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014945183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014945183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014945184 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014945184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014945184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014945184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:47.303910 run osmo-stp_10.42.42.5(pid=25829): stdout: | (launched: 2022-12-14_01:49:45.014811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:49:47.436345 run osmo-stp_10.42.42.5(pid=25829): stderr: | [0;m[38;5;43m20221214014945183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214014945183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214014945183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214014945184 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214014945184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214014945184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214014945184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:49:47.591466 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=25829): Process ended prematurely: osmo-stp_10.42.42.5(pid=25829) [trial-2397↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25829)] [trial-2397↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 01:49:47.600795 tst emergency_preemptive_call.py:32: Test FAILED (6.9 sec) 01:49:47.628266 run osmo-hlr_10.42.42.2(pid=25826): ERR: Terminated: ERROR {rc=237} [trial-2397↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25826)] 01:49:47.679343 run osmo-hlr_10.42.42.2(pid=25826): stdout: | (launched: 2022-12-14_01:49:44.092393) 01:49:47.730868 run osmo-hlr_10.42.42.2(pid=25826): stderr: | [0;m[1;31m20221214014944266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214014944266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214014944266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214014944266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214014944266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214014944266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214014944279 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214014944287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214014944288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214014944288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:49:47.803503 run osmo-msc_10.42.42.6(pid=25832): ERR: Terminated: ERROR {rc=2} [trial-2397↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25832)] 01:49:47.853113 run osmo-msc_10.42.42.6(pid=25832): stdout: | (launched: 2022-12-14_01:49:46.209327) 01:49:47.904866 run osmo-msc_10.42.42.6(pid=25832): stderr: | [0;m[38;5;43m20221214014946689 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214014946690 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5027652c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214014946690 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214014946690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214014946690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214014946690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214014946692 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214014946692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214014946693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214014946693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:49:47.957268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25825): Terminating (SIGTERM) 01:49:47.999679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25828): Terminating (SIGTERM) 01:49:48.042506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25831): Terminating (SIGTERM) 01:49:48.085367 --- ParallelTerminationStrategy: PID 25825 died... 01:49:48.105779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25825): Terminated: ok {rc=0} 01:49:48.152390 --- ParallelTerminationStrategy: PID 25828 died... 01:49:48.172351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25828): Terminated: ok {rc=0} 01:49:48.218998 --- ParallelTerminationStrategy: PID 25831 died... 01:49:48.239091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25831): Terminated: ok {rc=0} 01:49:48.326843 bus /sierra_9: Setting Powered False 01:49:49.424670 bus /sierra_9: Setting Powered False 01:49:50.540932 bus /sierra_8: Setting Powered False 01:49:51.637542 bus /sierra_8: Setting Powered False 01:49:52.753020 bus /sierra_3: Setting Powered False 01:49:53.850502 bus /sierra_3: Setting Powered False 01:49:54.966400 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:nanobts+band-900 --------------------------------------------------------------------- 01:49:56.243698 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:49:56.249477 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 01:49:56.282254 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 01:49:56.322768 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 01:49:56.413903 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 01:49:56.447520 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 01:49:56.487161 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 01:49:57.078684 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 01:49:57.132300 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:57.143685 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 01:49:57.192430 tst cs_paging_gprs_active.py: using LAC 37711 01:49:57.319426 tst cs_paging_gprs_active.py: using RAC 226 01:49:57.446846 tst cs_paging_gprs_active.py: using CellId 37711 01:49:57.575138 tst cs_paging_gprs_active.py: using BVCI 37712 01:49:57.693550 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:57.704690 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:57.715684 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:57.726686 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:57.737955 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:57.749398 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:57.760846 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:57.772183 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:49:57.783734 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:57.901425 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:49:58.025040 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:49:58.245854 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:49:58.574223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25837): Launched 01:49:58.859437 run iperf3-srv_10.42.42.10(pid=25838): Launched 01:49:58.983480 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:49:59.204081 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:49:59.531928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25839): Launched 01:49:59.817214 run iperf3-srv_10.42.42.10(pid=25840): Launched 01:49:59.939134 tst cs_paging_gprs_active.py:38: start network... 01:50:00.159559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:50:00.641062 run create_hlr_db(pid=25841): Launched 01:50:00.766648 bus /sierra_2: Setting Powered False 01:50:01.848344 run create_hlr_db(pid=25841): Terminated: ok {rc=0} 01:50:02.330777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25846): Launched 01:50:02.658757 run osmo-hlr_10.42.42.2(pid=25847): Launched 01:50:02.784748 run osmo-stp_10.42.42.5: Starting osmo-stp 01:50:03.351245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25849): Launched 01:50:03.678019 run osmo-stp_10.42.42.5(pid=25850): Launched 01:50:03.804163 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:50:04.368528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25852): Launched 01:50:04.493412 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:50:04.769707 run patchelf(pid=25853): Launched 01:50:04.951632 run osmo-stp_10.42.42.5(pid=25850): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25850)] 01:50:05.091043 run osmo-stp_10.42.42.5(pid=25850): stdout: | (launched: 2022-12-14_01:50:03.617161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:05.231175 run osmo-stp_10.42.42.5(pid=25850): stderr: | [0;m[38;5;43m20221214015003809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015003809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015003809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015003810 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015003810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015003810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015003810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:05.371085 run osmo-stp_10.42.42.5(pid=25850): stdout: | (launched: 2022-12-14_01:50:03.617161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:05.504423 run osmo-stp_10.42.42.5(pid=25850): stderr: | [0;m[38;5;43m20221214015003809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015003809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015003809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015003810 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015003810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015003810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015003810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:05.662641 run patchelf(pid=25853): Terminating (SIGINT) 01:50:05.845510 run patchelf(pid=25853): Terminated: ok {rc=0} 01:50:05.977517 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25850): Process ended prematurely: osmo-stp_10.42.42.5(pid=25850) [trial-2397↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25850)] [trial-2397↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 01:50:05.987750 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 01:50:06.016576 run osmo-hlr_10.42.42.2(pid=25847): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25847)] 01:50:06.066641 run osmo-hlr_10.42.42.2(pid=25847): stdout: | (launched: 2022-12-14_01:50:02.598581) 01:50:06.118504 run osmo-hlr_10.42.42.2(pid=25847): stderr: | [0;m[1;31m20221214015002795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015002795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015002795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015002795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015002795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015002795 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015002808 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015002818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015002818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015002818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:50:06.170480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25837): Terminating (SIGTERM) 01:50:06.211700 run iperf3-srv_10.42.42.10(pid=25838): Terminating (SIGTERM) 01:50:06.253303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25839): Terminating (SIGTERM) 01:50:06.295199 run iperf3-srv_10.42.42.10(pid=25840): Terminating (SIGTERM) 01:50:06.336640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25846): Terminating (SIGTERM) 01:50:06.378161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25849): Terminating (SIGTERM) 01:50:06.419575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25852): Terminating (SIGTERM) 01:50:06.462099 --- ParallelTerminationStrategy: PID 25837 died... 01:50:06.482313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25837): Terminated: ok {rc=0} 01:50:06.528482 --- ParallelTerminationStrategy: PID 25838 died... 01:50:06.548334 run iperf3-srv_10.42.42.10(pid=25838): Terminated {rc=256} 01:50:06.593890 --- ParallelTerminationStrategy: PID 25839 died... 01:50:06.613434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25839): Terminated: ok {rc=0} 01:50:06.658846 --- ParallelTerminationStrategy: PID 25840 died... 01:50:06.678473 run iperf3-srv_10.42.42.10(pid=25840): Terminated {rc=256} 01:50:06.723956 --- ParallelTerminationStrategy: PID 25846 died... 01:50:06.743441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25846): Terminated: ok {rc=0} 01:50:06.788930 --- ParallelTerminationStrategy: PID 25849 died... 01:50:06.809058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25849): Terminated: ok {rc=0} 01:50:06.855131 --- ParallelTerminationStrategy: PID 25852 died... 01:50:06.875199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25852): Terminated: ok {rc=0} 01:50:06.963284 bus /gobi_0: Setting Powered False 01:50:08.062696 bus /gobi_0: Setting Powered False 01:50:09.177721 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 01:50:10.327070 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:10.339057 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 01:50:10.395697 tst iperf3.py: using LAC 37712 01:50:10.514848 tst iperf3.py: using RAC 227 01:50:10.633751 tst iperf3.py: using CellId 37712 01:50:10.751300 tst iperf3.py: using BVCI 37713 01:50:10.861638 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:10.872543 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:10.883390 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:10.893954 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:10.904351 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:10.915287 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:10.926180 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:10.937224 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:10.947932 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:50:11.066995 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:50:11.286562 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:11.614014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25854): Launched 01:50:11.901617 run iperf3-srv_10.42.42.10(pid=25855): Launched 01:50:12.024879 tst iperf3.py:8: start network... 01:50:12.245131 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:50:12.751854 run create_hlr_db(pid=25856): Launched 01:50:12.877890 bus /gobi_6: Setting Powered False 01:50:13.942412 run create_hlr_db(pid=25856): Terminated: ok {rc=0} 01:50:14.379672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25858): Launched 01:50:14.685587 run osmo-hlr_10.42.42.2(pid=25859): Launched 01:50:14.803659 run osmo-stp_10.42.42.5: Starting osmo-stp 01:50:15.332792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25861): Launched 01:50:15.637694 run osmo-stp_10.42.42.5(pid=25862): Launched 01:50:15.755645 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:50:16.356495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25864): Launched 01:50:16.485179 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:50:16.772670 run patchelf(pid=25865): Launched 01:50:16.958748 run osmo-stp_10.42.42.5(pid=25862): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25862)] 01:50:17.088714 run osmo-stp_10.42.42.5(pid=25862): stdout: | (launched: 2022-12-14_01:50:15.580388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:17.221630 run osmo-stp_10.42.42.5(pid=25862): stderr: | [0;m[38;5;43m20221214015015749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015015749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015015749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015015750 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015015750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015015750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015015750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:17.353246 run osmo-stp_10.42.42.5(pid=25862): stdout: | (launched: 2022-12-14_01:50:15.580388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:17.477239 run osmo-stp_10.42.42.5(pid=25862): stderr: | [0;m[38;5;43m20221214015015749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015015749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015015749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015015750 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015015750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015015750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015015750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:17.624274 run patchelf(pid=25865): Terminating (SIGINT) 01:50:17.794448 run patchelf(pid=25865): Terminated: ok {rc=0} 01:50:17.917554 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25862): Process ended prematurely: osmo-stp_10.42.42.5(pid=25862) [trial-2397↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25862)] [trial-2397↪gprs:nanobts+band-900↪iperf3.py:8] 01:50:17.927194 tst iperf3.py:8: Test FAILED (7.6 sec) 01:50:17.954482 run osmo-hlr_10.42.42.2(pid=25859): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25859)] 01:50:18.002118 run osmo-hlr_10.42.42.2(pid=25859): stdout: | (launched: 2022-12-14_01:50:14.628562) 01:50:18.051395 run osmo-hlr_10.42.42.2(pid=25859): stderr: | [0;m[1;31m20221214015014802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015014802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015014802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015014802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015014802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015014802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015014814 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015014822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015014822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015014822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:50:18.101735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25854): Terminating (SIGTERM) 01:50:18.141469 run iperf3-srv_10.42.42.10(pid=25855): Terminating (SIGTERM) 01:50:18.182724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25858): Terminating (SIGTERM) 01:50:18.227383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25861): Terminating (SIGTERM) 01:50:18.269123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25864): Terminating (SIGTERM) 01:50:18.311143 --- ParallelTerminationStrategy: PID 25854 died... 01:50:18.331421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25854): Terminated: ok {rc=0} 01:50:18.377794 --- ParallelTerminationStrategy: PID 25855 died... 01:50:18.397410 run iperf3-srv_10.42.42.10(pid=25855): Terminated {rc=256} 01:50:18.443879 --- ParallelTerminationStrategy: PID 25858 died... 01:50:18.463651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25858): Terminated: ok {rc=0} 01:50:18.509680 --- ParallelTerminationStrategy: PID 25861 died... 01:50:18.529513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25861): Terminated: ok {rc=0} 01:50:18.575741 --- ParallelTerminationStrategy: PID 25864 died... 01:50:18.595809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25864): Terminated: ok {rc=0} 01:50:18.683837 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 01:50:19.833076 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:19.844885 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 01:50:19.893428 tst iperf3m4.py: using LAC 37713 01:50:20.012912 tst iperf3m4.py: using RAC 228 01:50:20.132266 tst iperf3m4.py: using CellId 37713 01:50:20.252806 tst iperf3m4.py: using BVCI 37714 01:50:20.362334 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:20.373117 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:20.383833 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:20.394513 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:20.405711 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:20.416753 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:20.427979 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:20.439016 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:20.450222 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:50:20.571216 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:50:20.690894 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:50:20.810929 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:50:20.927420 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:50:21.131046 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:21.436210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25866): Launched 01:50:21.702075 run iperf3-srv_10.42.42.10(pid=25867): Launched 01:50:21.818361 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:50:22.021770 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:22.327680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25868): Launched 01:50:22.595083 run iperf3-srv_10.42.42.10(pid=25869): Launched 01:50:22.710401 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:50:22.912494 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:23.217600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25870): Launched 01:50:23.484777 run iperf3-srv_10.42.42.10(pid=25871): Launched 01:50:23.598284 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:50:23.800104 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:24.105270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25872): Launched 01:50:24.372493 run iperf3-srv_10.42.42.10(pid=25873): Launched 01:50:24.487257 tst iperf3m4.py:8: start network... 01:50:24.689601 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:50:25.161679 run create_hlr_db(pid=25874): Launched 01:50:25.286015 bus /gobi_6: Setting Powered False 01:50:26.346874 run create_hlr_db(pid=25874): Terminated: ok {rc=0} 01:50:26.792435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25876): Launched 01:50:27.122219 run osmo-hlr_10.42.42.2(pid=25877): Launched 01:50:27.247535 run osmo-stp_10.42.42.5: Starting osmo-stp 01:50:27.813281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25879): Launched 01:50:28.143782 run osmo-stp_10.42.42.5(pid=25880): Launched 01:50:28.270056 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:50:28.833064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25882): Launched 01:50:28.959338 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:50:29.235748 run patchelf(pid=25883): Launched 01:50:29.419103 run osmo-stp_10.42.42.5(pid=25880): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25880)] 01:50:29.557366 run osmo-stp_10.42.42.5(pid=25880): stdout: | (launched: 2022-12-14_01:50:28.082935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:29.697924 run osmo-stp_10.42.42.5(pid=25880): stderr: | [0;m[38;5;43m20221214015028272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015028272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015028273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015028273 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015028274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015028274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015028274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:29.838087 run osmo-stp_10.42.42.5(pid=25880): stdout: | (launched: 2022-12-14_01:50:28.082935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:29.971183 run osmo-stp_10.42.42.5(pid=25880): stderr: | [0;m[38;5;43m20221214015028272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015028272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015028273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015028273 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015028274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015028274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015028274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:30.129818 run patchelf(pid=25883): Terminating (SIGINT) 01:50:30.312822 run patchelf(pid=25883): Terminated: ok {rc=0} 01:50:30.445132 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25880): Process ended prematurely: osmo-stp_10.42.42.5(pid=25880) [trial-2397↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25880)] [trial-2397↪gprs:nanobts+band-900↪iperf3m4.py:8] 01:50:30.455488 tst iperf3m4.py:8: Test FAILED (10.7 sec) 01:50:30.484457 run osmo-hlr_10.42.42.2(pid=25877): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25877)] 01:50:30.535211 run osmo-hlr_10.42.42.2(pid=25877): stdout: | (launched: 2022-12-14_01:50:27.061580) 01:50:30.587833 run osmo-hlr_10.42.42.2(pid=25877): stderr: | [0;m[1;31m20221214015027258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015027258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015027258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015027258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015027258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015027258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015027273 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015027283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015027283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015027283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:50:30.640744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25866): Terminating (SIGTERM) 01:50:30.682565 run iperf3-srv_10.42.42.10(pid=25867): Terminating (SIGTERM) 01:50:30.724929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25868): Terminating (SIGTERM) 01:50:30.767051 run iperf3-srv_10.42.42.10(pid=25869): Terminating (SIGTERM) 01:50:30.809348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25870): Terminating (SIGTERM) 01:50:30.869265 run iperf3-srv_10.42.42.10(pid=25871): Terminating (SIGTERM) 01:50:30.910833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25872): Terminating (SIGTERM) 01:50:30.952618 run iperf3-srv_10.42.42.10(pid=25873): Terminating (SIGTERM) 01:50:30.996098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25876): Terminating (SIGTERM) 01:50:31.039405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25879): Terminating (SIGTERM) 01:50:31.082463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25882): Terminating (SIGTERM) 01:50:31.125982 --- ParallelTerminationStrategy: PID 25866 died... 01:50:31.146788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25866): Terminated: ok {rc=0} 01:50:31.194585 --- ParallelTerminationStrategy: PID 25867 died... 01:50:31.213827 run iperf3-srv_10.42.42.10(pid=25867): Terminated {rc=256} 01:50:31.258889 --- ParallelTerminationStrategy: PID 25868 died... 01:50:31.278152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25868): Terminated: ok {rc=0} 01:50:31.323235 --- ParallelTerminationStrategy: PID 25869 died... 01:50:31.342828 run iperf3-srv_10.42.42.10(pid=25869): Terminated {rc=256} 01:50:31.389224 --- ParallelTerminationStrategy: PID 25870 died... 01:50:31.408557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25870): Terminated: ok {rc=0} 01:50:31.453625 --- ParallelTerminationStrategy: PID 25871 died... 01:50:31.473262 run iperf3-srv_10.42.42.10(pid=25871): Terminated {rc=256} 01:50:31.518017 --- ParallelTerminationStrategy: PID 25872 died... 01:50:31.537609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25872): Terminated: ok {rc=0} 01:50:31.584383 --- ParallelTerminationStrategy: PID 25873 died... 01:50:31.604071 run iperf3-srv_10.42.42.10(pid=25873): Terminated {rc=256} 01:50:31.649571 --- ParallelTerminationStrategy: PID 25876 died... 01:50:31.669541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25876): Terminated: ok {rc=0} 01:50:31.714876 --- ParallelTerminationStrategy: PID 25879 died... 01:50:31.734442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25879): Terminated: ok {rc=0} 01:50:31.779624 --- ParallelTerminationStrategy: PID 25882 died... 01:50:31.800385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25882): Terminated: ok {rc=0} 01:50:31.887519 bus /gobi_4: Setting Powered False 01:50:32.989202 bus /gobi_4: Setting Powered False 01:50:34.105419 bus /gobi_1: Setting Powered False 01:50:35.203311 bus /gobi_1: Setting Powered False 01:50:36.318738 bus /gobi_0: Setting Powered False 01:50:37.418476 bus /gobi_0: Setting Powered False 01:50:38.538804 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-900 ping.py ---------------------------------------------- 01:50:39.642979 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:39.655011 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 01:50:39.704642 tst ping.py: using LAC 37714 01:50:39.823761 tst ping.py: using RAC 229 01:50:39.942535 tst ping.py: using CellId 37714 01:50:40.060510 tst ping.py: using BVCI 37715 01:50:40.168089 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:40.179004 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:40.189792 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:40.200311 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:40.210994 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:40.221947 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:40.233158 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:40.243628 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:50:40.362195 tst ping.py:19: start network... 01:50:40.577803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:50:41.072742 run create_hlr_db(pid=25884): Launched 01:50:41.196014 bus /gobi_6: Setting Powered False 01:50:42.258777 run create_hlr_db(pid=25884): Terminated: ok {rc=0} 01:50:42.686367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25886): Launched 01:50:42.987785 run osmo-hlr_10.42.42.2(pid=25887): Launched 01:50:43.100782 run osmo-stp_10.42.42.5: Starting osmo-stp 01:50:43.633365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25889): Launched 01:50:43.931575 run osmo-stp_10.42.42.5(pid=25890): Launched 01:50:44.045855 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:50:44.559454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25892): Launched 01:50:44.673028 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:50:44.925197 run patchelf(pid=25893): Launched 01:50:45.090374 run osmo-stp_10.42.42.5(pid=25890): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25890)] 01:50:45.216023 run osmo-stp_10.42.42.5(pid=25890): stdout: | (launched: 2022-12-14_01:50:43.875778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:45.343548 run osmo-stp_10.42.42.5(pid=25890): stderr: | [0;m[38;5;43m20221214015044044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015044044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015044045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015044045 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015044046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015044046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015044046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:45.470799 run osmo-stp_10.42.42.5(pid=25890): stdout: | (launched: 2022-12-14_01:50:43.875778) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:45.591597 run osmo-stp_10.42.42.5(pid=25890): stderr: | [0;m[38;5;43m20221214015044044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015044044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015044045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015044045 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015044046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015044046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015044046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:45.735120 run patchelf(pid=25893): Terminating (SIGINT) 01:50:45.914070 run patchelf(pid=25893): Terminated: ok {rc=0} 01:50:46.035217 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25890): Process ended prematurely: osmo-stp_10.42.42.5(pid=25890) [trial-2397↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25890)] [trial-2397↪gprs:nanobts+band-900↪ping.py:22] 01:50:46.044660 tst ping.py:22: Test FAILED (6.4 sec) 01:50:46.072156 run osmo-hlr_10.42.42.2(pid=25887): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25887)] 01:50:46.121190 run osmo-hlr_10.42.42.2(pid=25887): stdout: | (launched: 2022-12-14_01:50:42.930806) 01:50:46.170957 run osmo-hlr_10.42.42.2(pid=25887): stderr: | [0;m[1;31m20221214015043106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015043106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015043106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015043106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015043106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015043106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015043118 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015043127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015043127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015043127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:50:46.221389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25886): Terminating (SIGTERM) 01:50:46.261976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25889): Terminating (SIGTERM) 01:50:46.303764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25892): Terminating (SIGTERM) 01:50:46.346979 --- ParallelTerminationStrategy: PID 25886 died... 01:50:46.366592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25886): Terminated: ok {rc=0} 01:50:46.413310 --- ParallelTerminationStrategy: PID 25889 died... 01:50:46.432543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25889): Terminated: ok {rc=0} 01:50:46.477636 --- ParallelTerminationStrategy: PID 25892 died... 01:50:46.497110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25892): Terminated: ok {rc=0} 01:50:46.591029 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 01:50:47.692627 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:47.704022 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 01:50:47.752006 tst ping_idle_ping.py: using LAC 37715 01:50:47.874677 tst ping_idle_ping.py: using RAC 230 01:50:47.991837 tst ping_idle_ping.py: using CellId 37715 01:50:48.108650 tst ping_idle_ping.py: using BVCI 37716 01:50:48.217353 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:48.228000 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:48.238677 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:48.249321 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:48.259798 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:48.271614 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:48.282926 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 01:50:48.294022 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 01:50:48.413185 tst ping_idle_ping.py:24: start network... 01:50:48.629750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:50:49.129688 run create_hlr_db(pid=25894): Launched 01:50:49.252505 bus /gobi_6: Setting Powered False 01:50:50.316644 run create_hlr_db(pid=25894): Terminated: ok {rc=0} 01:50:50.747482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25896): Launched 01:50:51.049106 run osmo-hlr_10.42.42.2(pid=25897): Launched 01:50:51.162738 run osmo-stp_10.42.42.5: Starting osmo-stp 01:50:51.694045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25899): Launched 01:50:51.996882 run osmo-stp_10.42.42.5(pid=25904): Launched 01:50:52.111061 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:50:52.626996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25907): Launched 01:50:52.742906 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:50:52.995403 run patchelf(pid=25908): Launched 01:50:53.161449 run osmo-stp_10.42.42.5(pid=25904): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25904)] 01:50:53.287586 run osmo-stp_10.42.42.5(pid=25904): stdout: | (launched: 2022-12-14_01:50:51.939932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:53.415432 run osmo-stp_10.42.42.5(pid=25904): stderr: | [0;m[38;5;43m20221214015052107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015052108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015052108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015052108 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015052109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015052109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015052109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:53.543494 run osmo-stp_10.42.42.5(pid=25904): stdout: | (launched: 2022-12-14_01:50:51.939932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:50:53.664883 run osmo-stp_10.42.42.5(pid=25904): stderr: | [0;m[38;5;43m20221214015052107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015052108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015052108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015052108 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015052109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015052109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015052109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:50:53.809368 run patchelf(pid=25908): Terminating (SIGINT) 01:50:53.977567 run patchelf(pid=25908): Terminated: ok {rc=0} 01:50:54.098583 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25904): Process ended prematurely: osmo-stp_10.42.42.5(pid=25904) [trial-2397↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25904)] [trial-2397↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 01:50:54.107345 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 01:50:54.134300 run osmo-hlr_10.42.42.2(pid=25897): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25897)] 01:50:54.181643 run osmo-hlr_10.42.42.2(pid=25897): stdout: | (launched: 2022-12-14_01:50:50.992881) 01:50:54.230420 run osmo-hlr_10.42.42.2(pid=25897): stderr: | [0;m[1;31m20221214015051167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015051167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015051167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015051167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015051167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015051167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015051179 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015051189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015051189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015051189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:50:54.280107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25896): Terminating (SIGTERM) 01:50:54.319884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25899): Terminating (SIGTERM) 01:50:54.359662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25907): Terminating (SIGTERM) 01:50:54.399717 --- ParallelTerminationStrategy: PID 25896 died... 01:50:54.418939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25896): Terminated: ok {rc=0} 01:50:54.462787 --- ParallelTerminationStrategy: PID 25899 died... 01:50:54.481854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25899): Terminated: ok {rc=0} 01:50:54.525827 --- ParallelTerminationStrategy: PID 25907 died... 01:50:54.544503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25907): Terminated: ok {rc=0} 01:50:54.627471 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 01:50:55.930228 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:50:55.936938 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 01:50:55.969259 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 01:50:56.007526 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 01:50:56.099555 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 01:50:56.131648 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 01:50:56.169501 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 01:50:56.764426 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 01:50:56.813151 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:56.823984 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:50:56.870902 tst cs_paging_gprs_active.py: using LAC 37716 01:50:56.988125 tst cs_paging_gprs_active.py: using RAC 231 01:50:57.116848 tst cs_paging_gprs_active.py: using CellId 37716 01:50:57.243763 tst cs_paging_gprs_active.py: using BVCI 37717 01:50:57.363061 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:57.374875 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:57.386358 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:57.397870 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:57.409878 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:57.422008 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:57.434153 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:57.446121 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:50:57.458411 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:50:57.579028 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:50:57.699497 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:50:57.921143 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:58.250298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25912): Launched 01:50:58.535327 run iperf3-srv_10.42.42.10(pid=25913): Launched 01:50:58.659228 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:50:58.879031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:50:59.207844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25914): Launched 01:50:59.495046 run iperf3-srv_10.42.42.10(pid=25915): Launched 01:50:59.618720 tst cs_paging_gprs_active.py:38: start network... 01:50:59.838789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:51:00.344919 run create_hlr_db(pid=25916): Launched 01:51:00.470947 bus /gobi_6: Setting Powered False 01:51:01.530822 run create_hlr_db(pid=25916): Terminated: ok {rc=0} 01:51:02.050551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25918): Launched 01:51:02.395316 run osmo-hlr_10.42.42.2(pid=25919): Launched 01:51:02.522928 run osmo-stp_10.42.42.5: Starting osmo-stp 01:51:03.085545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25921): Launched 01:51:03.414141 run osmo-stp_10.42.42.5(pid=25922): Launched 01:51:03.540201 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:51:04.106537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25924): Launched 01:51:04.234174 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:51:04.511121 run patchelf(pid=25925): Launched 01:51:04.695338 run osmo-stp_10.42.42.5(pid=25922): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25922)] 01:51:04.833279 run osmo-stp_10.42.42.5(pid=25922): stdout: | (launched: 2022-12-14_01:51:03.353637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:04.972275 run osmo-stp_10.42.42.5(pid=25922): stderr: | [0;m[38;5;43m20221214015103542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015103542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015103543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015103543 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015103543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015103544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015103544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:05.111882 run osmo-stp_10.42.42.5(pid=25922): stdout: | (launched: 2022-12-14_01:51:03.353637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:05.245256 run osmo-stp_10.42.42.5(pid=25922): stderr: | [0;m[38;5;43m20221214015103542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015103542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015103543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015103543 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015103543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015103544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015103544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:05.403257 run patchelf(pid=25925): Terminating (SIGINT) 01:51:05.585440 run patchelf(pid=25925): Terminated: ok {rc=0} 01:51:05.716567 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25922): Process ended prematurely: osmo-stp_10.42.42.5(pid=25922) [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25922)] [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 01:51:05.726802 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 01:51:05.755288 run osmo-hlr_10.42.42.2(pid=25919): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25919)] 01:51:05.805417 run osmo-hlr_10.42.42.2(pid=25919): stdout: | (launched: 2022-12-14_01:51:02.334606) 01:51:05.856696 run osmo-hlr_10.42.42.2(pid=25919): stderr: | [0;m[1;31m20221214015102528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015102528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015102528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015102528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015102529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015102529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015102553 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015102562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015102562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015102562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:51:05.908645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25912): Terminating (SIGTERM) 01:51:05.950367 run iperf3-srv_10.42.42.10(pid=25913): Terminating (SIGTERM) 01:51:05.991894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25914): Terminating (SIGTERM) 01:51:06.034216 run iperf3-srv_10.42.42.10(pid=25915): Terminating (SIGTERM) 01:51:06.075773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25918): Terminating (SIGTERM) 01:51:06.117355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25921): Terminating (SIGTERM) 01:51:06.158685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25924): Terminating (SIGTERM) 01:51:06.200276 --- ParallelTerminationStrategy: PID 25912 died... 01:51:06.220359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25912): Terminated: ok {rc=0} 01:51:06.267245 --- ParallelTerminationStrategy: PID 25913 died... 01:51:06.287071 run iperf3-srv_10.42.42.10(pid=25913): Terminated {rc=256} 01:51:06.332899 --- ParallelTerminationStrategy: PID 25914 died... 01:51:06.352736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25914): Terminated: ok {rc=0} 01:51:06.398428 --- ParallelTerminationStrategy: PID 25915 died... 01:51:06.418122 run iperf3-srv_10.42.42.10(pid=25915): Terminated {rc=256} 01:51:06.463670 --- ParallelTerminationStrategy: PID 25918 died... 01:51:06.483491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25918): Terminated: ok {rc=0} 01:51:06.529244 --- ParallelTerminationStrategy: PID 25921 died... 01:51:06.548836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25921): Terminated: ok {rc=0} 01:51:06.595439 --- ParallelTerminationStrategy: PID 25924 died... 01:51:06.615349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25924): Terminated: ok {rc=0} 01:51:06.703101 bus /gobi_0: Setting Powered False 01:51:07.801755 bus /gobi_0: Setting Powered False 01:51:08.917247 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 01:51:10.067063 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:10.079165 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:51:10.133272 tst iperf3.py: using LAC 37717 01:51:10.261418 tst iperf3.py: using RAC 232 01:51:10.389575 tst iperf3.py: using CellId 37717 01:51:10.509322 tst iperf3.py: using BVCI 37718 01:51:10.620238 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:10.631586 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:10.642692 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:10.653798 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:10.665336 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:10.676707 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:10.688365 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:10.699839 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:10.711470 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:51:10.831144 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:51:11.050981 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:11.379223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25926): Launched 01:51:11.666895 run iperf3-srv_10.42.42.10(pid=25927): Launched 01:51:11.790960 tst iperf3.py:8: start network... 01:51:12.011252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:51:12.517668 run create_hlr_db(pid=25928): Launched 01:51:12.643754 bus /gobi_6: Setting Powered False 01:51:13.707396 run create_hlr_db(pid=25928): Terminated: ok {rc=0} 01:51:14.143215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25930): Launched 01:51:14.448885 run osmo-hlr_10.42.42.2(pid=25931): Launched 01:51:14.564637 run osmo-stp_10.42.42.5: Starting osmo-stp 01:51:15.090595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25933): Launched 01:51:15.396349 run osmo-stp_10.42.42.5(pid=25934): Launched 01:51:15.511865 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:51:16.064688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25936): Launched 01:51:16.234981 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:51:16.508942 run patchelf(pid=25937): Launched 01:51:16.698777 run osmo-stp_10.42.42.5(pid=25934): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25934)] 01:51:16.830889 run osmo-stp_10.42.42.5(pid=25934): stdout: | (launched: 2022-12-14_01:51:15.339307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:16.965597 run osmo-stp_10.42.42.5(pid=25934): stderr: | [0;m[38;5;43m20221214015115507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015115507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015115507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015115507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015115508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015115508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015115508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:17.102210 run osmo-stp_10.42.42.5(pid=25934): stdout: | (launched: 2022-12-14_01:51:15.339307) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:17.229760 run osmo-stp_10.42.42.5(pid=25934): stderr: | [0;m[38;5;43m20221214015115507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015115507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015115507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015115507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015115508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015115508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015115508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:17.377717 run patchelf(pid=25937): Terminating (SIGINT) 01:51:17.548645 run patchelf(pid=25937): Terminated: ok {rc=0} 01:51:17.672246 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25934): Process ended prematurely: osmo-stp_10.42.42.5(pid=25934) [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25934)] [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 01:51:17.682131 tst iperf3.py:8: Test FAILED (7.7 sec) 01:51:17.709727 run osmo-hlr_10.42.42.2(pid=25931): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25931)] 01:51:17.757110 run osmo-hlr_10.42.42.2(pid=25931): stdout: | (launched: 2022-12-14_01:51:14.392316) 01:51:17.806013 run osmo-hlr_10.42.42.2(pid=25931): stderr: | [0;m[1;31m20221214015114564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015114564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015114564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015114565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015114565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015114565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015114577 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015114586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015114586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015114586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:51:17.855307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25926): Terminating (SIGTERM) 01:51:17.894585 run iperf3-srv_10.42.42.10(pid=25927): Terminating (SIGTERM) 01:51:17.934074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25930): Terminating (SIGTERM) 01:51:17.973032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25933): Terminating (SIGTERM) 01:51:18.011750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25936): Terminating (SIGTERM) 01:51:18.051165 --- ParallelTerminationStrategy: PID 25926 died... 01:51:18.070326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25926): Terminated: ok {rc=0} 01:51:18.114084 --- ParallelTerminationStrategy: PID 25927 died... 01:51:18.132796 run iperf3-srv_10.42.42.10(pid=25927): Terminated {rc=256} 01:51:18.176642 --- ParallelTerminationStrategy: PID 25930 died... 01:51:18.195532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25930): Terminated: ok {rc=0} 01:51:18.239351 --- ParallelTerminationStrategy: PID 25933 died... 01:51:18.258267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25933): Terminated: ok {rc=0} 01:51:18.302220 --- ParallelTerminationStrategy: PID 25936 died... 01:51:18.321108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25936): Terminated: ok {rc=0} 01:51:18.406217 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 01:51:19.555693 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:19.568176 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:51:19.625303 tst iperf3m4.py: using LAC 37718 01:51:19.752410 tst iperf3m4.py: using RAC 233 01:51:19.878461 tst iperf3m4.py: using CellId 37718 01:51:20.004670 tst iperf3m4.py: using BVCI 37719 01:51:20.123969 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:20.135707 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:20.147311 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:20.158853 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:20.170693 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:20.182450 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:20.194700 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:20.206507 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:20.218446 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:51:20.335539 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:51:20.457821 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:51:20.575715 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:51:20.696796 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:51:20.916942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:21.246086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25938): Launched 01:51:21.534305 run iperf3-srv_10.42.42.10(pid=25939): Launched 01:51:21.657111 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:51:21.876699 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:22.205680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25940): Launched 01:51:22.492210 run iperf3-srv_10.42.42.10(pid=25941): Launched 01:51:22.615981 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:51:22.835805 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:23.165167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25942): Launched 01:51:23.452036 run iperf3-srv_10.42.42.10(pid=25943): Launched 01:51:23.574810 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:51:23.794795 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:24.124030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25944): Launched 01:51:24.411204 run iperf3-srv_10.42.42.10(pid=25945): Launched 01:51:24.535169 tst iperf3m4.py:8: start network... 01:51:24.754783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:51:25.260500 run create_hlr_db(pid=25946): Launched 01:51:25.384932 bus /gobi_6: Setting Powered False 01:51:26.449351 run create_hlr_db(pid=25946): Terminated: ok {rc=0} 01:51:26.886636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25948): Launched 01:51:27.193484 run osmo-hlr_10.42.42.2(pid=25949): Launched 01:51:27.312878 run osmo-stp_10.42.42.5: Starting osmo-stp 01:51:27.855265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25951): Launched 01:51:28.161783 run osmo-stp_10.42.42.5(pid=25952): Launched 01:51:28.278629 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:51:28.802015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25954): Launched 01:51:28.917522 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:51:29.173708 run patchelf(pid=25955): Launched 01:51:29.342189 run osmo-stp_10.42.42.5(pid=25952): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25952)] 01:51:29.469804 run osmo-stp_10.42.42.5(pid=25952): stdout: | (launched: 2022-12-14_01:51:28.104761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:29.599930 run osmo-stp_10.42.42.5(pid=25952): stderr: | [0;m[38;5;43m20221214015128274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015128274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015128274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015128275 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015128275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015128275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015128275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:29.730244 run osmo-stp_10.42.42.5(pid=25952): stdout: | (launched: 2022-12-14_01:51:28.104761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:29.853836 run osmo-stp_10.42.42.5(pid=25952): stderr: | [0;m[38;5;43m20221214015128274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015128274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015128274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015128275 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015128275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015128275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015128275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:30.000207 run patchelf(pid=25955): Terminating (SIGINT) 01:51:30.169534 run patchelf(pid=25955): Terminated: ok {rc=0} 01:51:30.291460 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25952): Process ended prematurely: osmo-stp_10.42.42.5(pid=25952) [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25952)] [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 01:51:30.301032 tst iperf3m4.py:8: Test FAILED (10.8 sec) 01:51:30.328447 run osmo-hlr_10.42.42.2(pid=25949): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25949)] 01:51:30.375278 run osmo-hlr_10.42.42.2(pid=25949): stdout: | (launched: 2022-12-14_01:51:27.136467) 01:51:30.423645 run osmo-hlr_10.42.42.2(pid=25949): stderr: | [0;m[1;31m20221214015127309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015127309 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015127310 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015127310 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015127310 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015127310 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015127321 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015127329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015127329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015127329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:51:30.472538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25938): Terminating (SIGTERM) 01:51:30.511462 run iperf3-srv_10.42.42.10(pid=25939): Terminating (SIGTERM) 01:51:30.550309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25940): Terminating (SIGTERM) 01:51:30.589690 run iperf3-srv_10.42.42.10(pid=25941): Terminating (SIGTERM) 01:51:30.628867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25942): Terminating (SIGTERM) 01:51:30.667874 run iperf3-srv_10.42.42.10(pid=25943): Terminating (SIGTERM) 01:51:30.706580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25944): Terminating (SIGTERM) 01:51:30.745496 run iperf3-srv_10.42.42.10(pid=25945): Terminating (SIGTERM) 01:51:30.784816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25948): Terminating (SIGTERM) 01:51:30.823753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25951): Terminating (SIGTERM) 01:51:30.882543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25954): Terminating (SIGTERM) 01:51:30.928294 --- ParallelTerminationStrategy: PID 25938 died... 01:51:30.950671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25938): Terminated: ok {rc=0} 01:51:31.001713 --- ParallelTerminationStrategy: PID 25939 died... 01:51:31.023392 run iperf3-srv_10.42.42.10(pid=25939): Terminated {rc=256} 01:51:31.073451 --- ParallelTerminationStrategy: PID 25940 died... 01:51:31.094611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25940): Terminated: ok {rc=0} 01:51:31.143314 --- ParallelTerminationStrategy: PID 25941 died... 01:51:31.164664 run iperf3-srv_10.42.42.10(pid=25941): Terminated {rc=256} 01:51:31.213732 --- ParallelTerminationStrategy: PID 25942 died... 01:51:31.235543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25942): Terminated: ok {rc=0} 01:51:31.283972 --- ParallelTerminationStrategy: PID 25943 died... 01:51:31.305629 run iperf3-srv_10.42.42.10(pid=25943): Terminated {rc=256} 01:51:31.354345 --- ParallelTerminationStrategy: PID 25944 died... 01:51:31.376255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25944): Terminated: ok {rc=0} 01:51:31.425719 --- ParallelTerminationStrategy: PID 25945 died... 01:51:31.447300 run iperf3-srv_10.42.42.10(pid=25945): Terminated {rc=256} 01:51:31.495474 --- ParallelTerminationStrategy: PID 25948 died... 01:51:31.517142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25948): Terminated: ok {rc=0} 01:51:31.566322 --- ParallelTerminationStrategy: PID 25951 died... 01:51:31.589385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25951): Terminated: ok {rc=0} 01:51:31.638424 --- ParallelTerminationStrategy: PID 25954 died... 01:51:31.659961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25954): Terminated: ok {rc=0} 01:51:31.752626 bus /gobi_4: Setting Powered False 01:51:32.850525 bus /gobi_4: Setting Powered False 01:51:33.967006 bus /gobi_1: Setting Powered False 01:51:35.066251 bus /gobi_1: Setting Powered False 01:51:36.182552 bus /gobi_0: Setting Powered False 01:51:37.280941 bus /gobi_0: Setting Powered False 01:51:38.399518 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 01:51:39.502430 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:39.514621 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:51:39.568142 tst ping.py: using LAC 37719 01:51:39.684523 tst ping.py: using RAC 234 01:51:39.810438 tst ping.py: using CellId 37719 01:51:39.933364 tst ping.py: using BVCI 37720 01:51:40.050547 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:40.062301 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:40.087165 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:40.100414 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:40.111847 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:40.123030 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:40.134880 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:40.146362 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:51:40.261568 tst ping.py:19: start network... 01:51:40.458895 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:51:40.916010 run create_hlr_db(pid=25956): Launched 01:51:41.038602 bus /gobi_6: Setting Powered False 01:51:42.098412 run create_hlr_db(pid=25956): Terminated: ok {rc=0} 01:51:42.536012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25958): Launched 01:51:42.855211 run osmo-hlr_10.42.42.2(pid=25959): Launched 01:51:42.976365 run osmo-stp_10.42.42.5: Starting osmo-stp 01:51:43.528428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25961): Launched 01:51:43.848650 run osmo-stp_10.42.42.5(pid=25962): Launched 01:51:43.969440 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:51:44.521272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25964): Launched 01:51:44.643418 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:51:44.914249 run patchelf(pid=25965): Launched 01:51:45.093088 run osmo-stp_10.42.42.5(pid=25962): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25962)] 01:51:45.228182 run osmo-stp_10.42.42.5(pid=25962): stdout: | (launched: 2022-12-14_01:51:43.789724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:45.365368 run osmo-stp_10.42.42.5(pid=25962): stderr: | [0;m[38;5;43m20221214015143975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015143975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015143975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015143976 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015143976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015143976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015143976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:45.502930 run osmo-stp_10.42.42.5(pid=25962): stdout: | (launched: 2022-12-14_01:51:43.789724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:45.633762 run osmo-stp_10.42.42.5(pid=25962): stderr: | [0;m[38;5;43m20221214015143975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015143975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015143975 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015143976 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015143976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015143976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015143976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:45.789123 run patchelf(pid=25965): Terminating (SIGINT) 01:51:45.996213 run patchelf(pid=25965): Terminated: ok {rc=0} 01:51:46.122962 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25962): Process ended prematurely: osmo-stp_10.42.42.5(pid=25962) [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25962)] [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 01:51:46.133098 tst ping.py:22: Test FAILED (6.6 sec) 01:51:46.161185 run osmo-hlr_10.42.42.2(pid=25959): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25959)] 01:51:46.210358 run osmo-hlr_10.42.42.2(pid=25959): stdout: | (launched: 2022-12-14_01:51:42.795864) 01:51:46.261065 run osmo-hlr_10.42.42.2(pid=25959): stderr: | [0;m[1;31m20221214015142989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015142989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015142989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015142989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015142989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015142989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015143003 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015143011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015143011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015143011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:51:46.311319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25958): Terminating (SIGTERM) 01:51:46.352456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25961): Terminating (SIGTERM) 01:51:46.396572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25964): Terminating (SIGTERM) 01:51:46.439702 --- ParallelTerminationStrategy: PID 25958 died... 01:51:46.459316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25958): Terminated: ok {rc=0} 01:51:46.506273 --- ParallelTerminationStrategy: PID 25961 died... 01:51:46.525930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25961): Terminated: ok {rc=0} 01:51:46.570893 --- ParallelTerminationStrategy: PID 25964 died... 01:51:46.591489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25964): Terminated: ok {rc=0} 01:51:46.675717 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 01:51:47.764735 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:47.777245 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 01:51:47.829166 tst ping_idle_ping.py: using LAC 37720 01:51:47.955677 tst ping_idle_ping.py: using RAC 235 01:51:48.082768 tst ping_idle_ping.py: using CellId 37720 01:51:48.203745 tst ping_idle_ping.py: using BVCI 37721 01:51:48.313090 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:48.324177 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:48.335155 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:48.346332 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:48.357195 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:48.367840 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:48.378861 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 01:51:48.389596 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 01:51:48.504369 tst ping_idle_ping.py:24: start network... 01:51:48.705285 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:51:49.171872 run create_hlr_db(pid=25966): Launched 01:51:49.294173 bus /gobi_6: Setting Powered False 01:51:50.354489 run create_hlr_db(pid=25966): Terminated: ok {rc=0} 01:51:50.792666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25968): Launched 01:51:51.114306 run osmo-hlr_10.42.42.2(pid=25969): Launched 01:51:51.234807 run osmo-stp_10.42.42.5: Starting osmo-stp 01:51:51.785536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25971): Launched 01:51:52.107167 run osmo-stp_10.42.42.5(pid=25972): Launched 01:51:52.228691 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:51:52.779655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25974): Launched 01:51:52.902071 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:51:53.172880 run patchelf(pid=25975): Launched 01:51:53.350368 run osmo-stp_10.42.42.5(pid=25972): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25972)] 01:51:53.485131 run osmo-stp_10.42.42.5(pid=25972): stdout: | (launched: 2022-12-14_01:51:52.047380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:53.622569 run osmo-stp_10.42.42.5(pid=25972): stderr: | [0;m[38;5;43m20221214015152235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015152235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015152235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015152236 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015152236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015152237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015152237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:53.759537 run osmo-stp_10.42.42.5(pid=25972): stdout: | (launched: 2022-12-14_01:51:52.047380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:51:53.890384 run osmo-stp_10.42.42.5(pid=25972): stderr: | [0;m[38;5;43m20221214015152235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015152235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015152235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015152236 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015152236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015152237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015152237 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:51:54.046022 run patchelf(pid=25975): Terminating (SIGINT) 01:51:54.225470 run patchelf(pid=25975): Terminated: ok {rc=0} 01:51:54.354473 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25972): Process ended prematurely: osmo-stp_10.42.42.5(pid=25972) [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25972)] [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 01:51:54.364256 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 01:51:54.392362 run osmo-hlr_10.42.42.2(pid=25969): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25969)] 01:51:54.443214 run osmo-hlr_10.42.42.2(pid=25969): stdout: | (launched: 2022-12-14_01:51:51.054674) 01:51:54.494515 run osmo-hlr_10.42.42.2(pid=25969): stderr: | [0;m[1;31m20221214015151249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015151249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015151249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015151249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015151249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015151249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015151262 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015151270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015151270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015151270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:51:54.546214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25968): Terminating (SIGTERM) 01:51:54.587482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25971): Terminating (SIGTERM) 01:51:54.629168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25974): Terminating (SIGTERM) 01:51:54.671216 --- ParallelTerminationStrategy: PID 25968 died... 01:51:54.691461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25968): Terminated: ok {rc=0} 01:51:54.737373 --- ParallelTerminationStrategy: PID 25971 died... 01:51:54.757242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25971): Terminated: ok {rc=0} 01:51:54.803033 --- ParallelTerminationStrategy: PID 25974 died... 01:51:54.822859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25974): Terminated: ok {rc=0} 01:51:54.910112 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 01:51:56.208703 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:51:56.218160 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 01:51:56.252481 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 01:51:56.292276 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 01:51:56.381607 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 01:51:56.416477 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 01:51:56.454791 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 01:51:57.051112 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 01:51:57.104250 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:57.115856 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:51:57.184336 tst cs_paging_gprs_active.py: using LAC 37721 01:51:57.313267 tst cs_paging_gprs_active.py: using RAC 236 01:51:57.441242 tst cs_paging_gprs_active.py: using CellId 37721 01:51:57.568189 tst cs_paging_gprs_active.py: using BVCI 37722 01:51:57.685998 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:57.697413 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:57.708622 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:57.719906 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:57.731487 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:57.742994 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:57.754693 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:57.766322 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:51:57.778181 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:51:57.894758 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:51:58.013381 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:51:58.234497 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:58.561715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25979): Launched 01:51:58.847120 run iperf3-srv_10.42.42.10(pid=25980): Launched 01:51:58.969268 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:51:59.190647 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:51:59.518414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25981): Launched 01:51:59.802946 run iperf3-srv_10.42.42.10(pid=25982): Launched 01:51:59.925267 tst cs_paging_gprs_active.py:38: start network... 01:52:00.145583 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:52:00.656185 run create_hlr_db(pid=25983): Launched 01:52:00.779286 bus /gobi_6: Setting Powered False 01:52:01.840916 run create_hlr_db(pid=25983): Terminated: ok {rc=0} 01:52:02.333788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25985): Launched 01:52:02.637828 run osmo-hlr_10.42.42.2(pid=25986): Launched 01:52:02.753788 run osmo-stp_10.42.42.5: Starting osmo-stp 01:52:03.282349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25988): Launched 01:52:03.586691 run osmo-stp_10.42.42.5(pid=25989): Launched 01:52:03.711824 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:52:04.273516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25991): Launched 01:52:04.399753 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:52:04.677121 run patchelf(pid=25992): Launched 01:52:04.858430 run osmo-stp_10.42.42.5(pid=25989): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25989)] 01:52:04.996284 run osmo-stp_10.42.42.5(pid=25989): stdout: | (launched: 2022-12-14_01:52:03.529613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:05.136063 run osmo-stp_10.42.42.5(pid=25989): stderr: | [0;m[38;5;43m20221214015203714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015203714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015203714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015203714 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015203715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015203715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015203715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:05.275725 run osmo-stp_10.42.42.5(pid=25989): stdout: | (launched: 2022-12-14_01:52:03.529613) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:05.408876 run osmo-stp_10.42.42.5(pid=25989): stderr: | [0;m[38;5;43m20221214015203714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015203714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015203714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015203714 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015203715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015203715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015203715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:05.566432 run patchelf(pid=25992): Terminating (SIGINT) 01:52:05.748814 run patchelf(pid=25992): Terminated: ok {rc=0} 01:52:05.880210 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25989): Process ended prematurely: osmo-stp_10.42.42.5(pid=25989) [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25989)] [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 01:52:05.890412 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:52:05.918737 run osmo-hlr_10.42.42.2(pid=25986): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25986)] 01:52:05.968838 run osmo-hlr_10.42.42.2(pid=25986): stdout: | (launched: 2022-12-14_01:52:02.580873) 01:52:06.020717 run osmo-hlr_10.42.42.2(pid=25986): stderr: | [0;m[1;31m20221214015202753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015202753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015202753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015202753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015202753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015202754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015202766 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015202774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015202774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015202774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:52:06.073320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25979): Terminating (SIGTERM) 01:52:06.114907 run iperf3-srv_10.42.42.10(pid=25980): Terminating (SIGTERM) 01:52:06.156367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25981): Terminating (SIGTERM) 01:52:06.198007 run iperf3-srv_10.42.42.10(pid=25982): Terminating (SIGTERM) 01:52:06.239659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25985): Terminating (SIGTERM) 01:52:06.281266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25988): Terminating (SIGTERM) 01:52:06.323268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25991): Terminating (SIGTERM) 01:52:06.365366 --- ParallelTerminationStrategy: PID 25979 died... 01:52:06.385464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25979): Terminated: ok {rc=0} 01:52:06.431517 --- ParallelTerminationStrategy: PID 25980 died... 01:52:06.451214 run iperf3-srv_10.42.42.10(pid=25980): Terminated {rc=256} 01:52:06.496764 --- ParallelTerminationStrategy: PID 25981 died... 01:52:06.516547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25981): Terminated: ok {rc=0} 01:52:06.562377 --- ParallelTerminationStrategy: PID 25982 died... 01:52:06.582091 run iperf3-srv_10.42.42.10(pid=25982): Terminated {rc=256} 01:52:06.627774 --- ParallelTerminationStrategy: PID 25985 died... 01:52:06.647510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25985): Terminated: ok {rc=0} 01:52:06.693302 --- ParallelTerminationStrategy: PID 25988 died... 01:52:06.712849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25988): Terminated: ok {rc=0} 01:52:06.758990 --- ParallelTerminationStrategy: PID 25991 died... 01:52:06.778719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25991): Terminated: ok {rc=0} 01:52:06.866051 bus /gobi_0: Setting Powered False 01:52:07.962970 bus /gobi_0: Setting Powered False 01:52:09.080829 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 01:52:10.222073 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:10.233864 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:52:10.304543 tst iperf3.py: using LAC 37722 01:52:10.433335 tst iperf3.py: using RAC 237 01:52:10.561077 tst iperf3.py: using CellId 37722 01:52:10.688871 tst iperf3.py: using BVCI 37723 01:52:10.806797 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:10.818507 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:10.829969 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:10.841242 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:10.852690 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:10.864278 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:10.875920 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:10.887345 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:10.899057 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:52:11.014592 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:52:11.217824 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:11.521942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25993): Launched 01:52:11.790096 run iperf3-srv_10.42.42.10(pid=25994): Launched 01:52:11.903206 tst iperf3.py:8: start network... 01:52:12.105925 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:52:12.575563 run create_hlr_db(pid=25995): Launched 01:52:12.699461 bus /gobi_6: Setting Powered False 01:52:13.759306 run create_hlr_db(pid=25995): Terminated: ok {rc=0} 01:52:14.181694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25997): Launched 01:52:14.486345 run osmo-hlr_10.42.42.2(pid=25998): Launched 01:52:14.600610 run osmo-stp_10.42.42.5: Starting osmo-stp 01:52:15.123475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26000): Launched 01:52:15.426130 run osmo-stp_10.42.42.5(pid=26001): Launched 01:52:15.539865 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:52:16.077719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26003): Launched 01:52:16.199884 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:52:16.463399 run patchelf(pid=26004): Launched 01:52:16.649082 run osmo-stp_10.42.42.5(pid=26001): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26001)] 01:52:16.778867 run osmo-stp_10.42.42.5(pid=26001): stdout: | (launched: 2022-12-14_01:52:15.369875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:16.911136 run osmo-stp_10.42.42.5(pid=26001): stderr: | [0;m[38;5;43m20221214015215536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015215536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015215536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015215536 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015215537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015215537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015215537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:17.043485 run osmo-stp_10.42.42.5(pid=26001): stdout: | (launched: 2022-12-14_01:52:15.369875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:17.169632 run osmo-stp_10.42.42.5(pid=26001): stderr: | [0;m[38;5;43m20221214015215536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015215536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015215536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015215536 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015215537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015215537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015215537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:17.316331 run patchelf(pid=26004): Terminating (SIGINT) 01:52:17.485695 run patchelf(pid=26004): Terminated: ok {rc=0} 01:52:17.607759 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26001): Process ended prematurely: osmo-stp_10.42.42.5(pid=26001) [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26001)] [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 01:52:17.617436 tst iperf3.py:8: Test FAILED (7.4 sec) 01:52:17.644490 run osmo-hlr_10.42.42.2(pid=25998): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25998)] 01:52:17.691916 run osmo-hlr_10.42.42.2(pid=25998): stdout: | (launched: 2022-12-14_01:52:14.429569) 01:52:17.740819 run osmo-hlr_10.42.42.2(pid=25998): stderr: | [0;m[1;31m20221214015214604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015214604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015214604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015214605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015214605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015214605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015214617 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015214626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015214626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015214626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:52:17.790296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25993): Terminating (SIGTERM) 01:52:17.829666 run iperf3-srv_10.42.42.10(pid=25994): Terminating (SIGTERM) 01:52:17.868779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25997): Terminating (SIGTERM) 01:52:17.908038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26000): Terminating (SIGTERM) 01:52:17.947152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26003): Terminating (SIGTERM) 01:52:17.986635 --- ParallelTerminationStrategy: PID 25993 died... 01:52:18.005466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25993): Terminated: ok {rc=0} 01:52:18.049197 --- ParallelTerminationStrategy: PID 25994 died... 01:52:18.067843 run iperf3-srv_10.42.42.10(pid=25994): Terminated {rc=256} 01:52:18.111595 --- ParallelTerminationStrategy: PID 25997 died... 01:52:18.130363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25997): Terminated: ok {rc=0} 01:52:18.174002 --- ParallelTerminationStrategy: PID 26000 died... 01:52:18.192989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26000): Terminated: ok {rc=0} 01:52:18.236796 --- ParallelTerminationStrategy: PID 26003 died... 01:52:18.255623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26003): Terminated: ok {rc=0} 01:52:18.340676 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 01:52:19.487240 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:19.499075 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:52:19.566097 tst iperf3m4.py: using LAC 37723 01:52:19.686591 tst iperf3m4.py: using RAC 238 01:52:19.804579 tst iperf3m4.py: using CellId 37723 01:52:19.925852 tst iperf3m4.py: using BVCI 37724 01:52:20.035795 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:20.046774 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:20.057773 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:20.068384 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:20.079082 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:20.089870 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:20.100691 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:20.111452 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:20.122293 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:52:20.240901 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:52:20.359731 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:52:20.480199 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:52:20.597971 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:52:20.816355 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:21.151845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26005): Launched 01:52:21.436399 run iperf3-srv_10.42.42.10(pid=26006): Launched 01:52:21.559124 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:52:21.778870 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:22.107422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26007): Launched 01:52:22.393688 run iperf3-srv_10.42.42.10(pid=26008): Launched 01:52:22.517713 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:52:22.738382 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:23.067568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26009): Launched 01:52:23.354570 run iperf3-srv_10.42.42.10(pid=26010): Launched 01:52:23.478724 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:52:23.698750 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:24.026353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26011): Launched 01:52:24.311080 run iperf3-srv_10.42.42.10(pid=26012): Launched 01:52:24.434608 tst iperf3m4.py:8: start network... 01:52:24.654600 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:52:25.159541 run create_hlr_db(pid=26013): Launched 01:52:25.283936 bus /gobi_6: Setting Powered False 01:52:26.348359 run create_hlr_db(pid=26013): Terminated: ok {rc=0} 01:52:26.782692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26015): Launched 01:52:27.086905 run osmo-hlr_10.42.42.2(pid=26016): Launched 01:52:27.202022 run osmo-stp_10.42.42.5: Starting osmo-stp 01:52:27.737434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26018): Launched 01:52:28.044172 run osmo-stp_10.42.42.5(pid=26019): Launched 01:52:28.160742 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:52:28.682384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26021): Launched 01:52:28.800702 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:52:29.056302 run patchelf(pid=26022): Launched 01:52:29.225570 run osmo-stp_10.42.42.5(pid=26019): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26019)] 01:52:29.354511 run osmo-stp_10.42.42.5(pid=26019): stdout: | (launched: 2022-12-14_01:52:27.987262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:29.484701 run osmo-stp_10.42.42.5(pid=26019): stderr: | [0;m[38;5;43m20221214015228156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015228156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015228157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015228157 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015228157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015228158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015228158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:29.614926 run osmo-stp_10.42.42.5(pid=26019): stdout: | (launched: 2022-12-14_01:52:27.987262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:29.738802 run osmo-stp_10.42.42.5(pid=26019): stderr: | [0;m[38;5;43m20221214015228156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015228156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015228157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015228157 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015228157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015228158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015228158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:29.885470 run patchelf(pid=26022): Terminating (SIGINT) 01:52:30.055357 run patchelf(pid=26022): Terminated: ok {rc=0} 01:52:30.177996 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26019): Process ended prematurely: osmo-stp_10.42.42.5(pid=26019) [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26019)] [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 01:52:30.187682 tst iperf3m4.py:8: Test FAILED (10.7 sec) 01:52:30.215211 run osmo-hlr_10.42.42.2(pid=26016): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26016)] 01:52:30.262893 run osmo-hlr_10.42.42.2(pid=26016): stdout: | (launched: 2022-12-14_01:52:27.030833) 01:52:30.311921 run osmo-hlr_10.42.42.2(pid=26016): stderr: | [0;m[1;31m20221214015227206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015227206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015227206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015227206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015227206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015227206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015227218 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015227226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015227226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015227227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:52:30.361466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26005): Terminating (SIGTERM) 01:52:30.400793 run iperf3-srv_10.42.42.10(pid=26006): Terminating (SIGTERM) 01:52:30.440028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26007): Terminating (SIGTERM) 01:52:30.479472 run iperf3-srv_10.42.42.10(pid=26008): Terminating (SIGTERM) 01:52:30.518660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26009): Terminating (SIGTERM) 01:52:30.558523 run iperf3-srv_10.42.42.10(pid=26010): Terminating (SIGTERM) 01:52:30.598287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26011): Terminating (SIGTERM) 01:52:30.637866 run iperf3-srv_10.42.42.10(pid=26012): Terminating (SIGTERM) 01:52:30.677196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26015): Terminating (SIGTERM) 01:52:30.716632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26018): Terminating (SIGTERM) 01:52:30.756173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26021): Terminating (SIGTERM) 01:52:30.796106 --- ParallelTerminationStrategy: PID 26005 died... 01:52:30.815479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26005): Terminated: ok {rc=0} 01:52:30.860287 --- ParallelTerminationStrategy: PID 26006 died... 01:52:30.880776 run iperf3-srv_10.42.42.10(pid=26006): Terminated {rc=256} 01:52:30.926878 --- ParallelTerminationStrategy: PID 26007 died... 01:52:30.946269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26007): Terminated: ok {rc=0} 01:52:30.990726 --- ParallelTerminationStrategy: PID 26008 died... 01:52:31.010592 run iperf3-srv_10.42.42.10(pid=26008): Terminated {rc=256} 01:52:31.055131 --- ParallelTerminationStrategy: PID 26009 died... 01:52:31.074410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26009): Terminated: ok {rc=0} 01:52:31.119167 --- ParallelTerminationStrategy: PID 26010 died... 01:52:31.139753 run iperf3-srv_10.42.42.10(pid=26010): Terminated {rc=256} 01:52:31.185514 --- ParallelTerminationStrategy: PID 26011 died... 01:52:31.205533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26011): Terminated: ok {rc=0} 01:52:31.251340 --- ParallelTerminationStrategy: PID 26012 died... 01:52:31.271330 run iperf3-srv_10.42.42.10(pid=26012): Terminated {rc=256} 01:52:31.316918 --- ParallelTerminationStrategy: PID 26015 died... 01:52:31.336827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26015): Terminated: ok {rc=0} 01:52:31.382345 --- ParallelTerminationStrategy: PID 26018 died... 01:52:31.402227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26018): Terminated: ok {rc=0} 01:52:31.447609 --- ParallelTerminationStrategy: PID 26021 died... 01:52:31.467660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26021): Terminated: ok {rc=0} 01:52:31.555189 bus /gobi_4: Setting Powered False 01:52:32.651424 bus /gobi_4: Setting Powered False 01:52:33.767163 bus /gobi_1: Setting Powered False 01:52:34.865615 bus /gobi_1: Setting Powered False 01:52:35.982356 bus /gobi_0: Setting Powered False 01:52:37.080633 bus /gobi_0: Setting Powered False 01:52:38.197363 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 01:52:39.297156 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:39.309273 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:52:39.377235 tst ping.py: using LAC 37724 01:52:39.495164 tst ping.py: using RAC 239 01:52:39.613872 tst ping.py: using CellId 37724 01:52:39.730574 tst ping.py: using BVCI 37725 01:52:39.839669 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:39.850878 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:39.861783 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:39.872502 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:39.883309 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:39.894171 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:39.905077 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:39.915822 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:52:40.035542 tst ping.py:19: start network... 01:52:40.251871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:52:40.746711 run create_hlr_db(pid=26023): Launched 01:52:40.870529 bus /gobi_6: Setting Powered False 01:52:41.934430 run create_hlr_db(pid=26023): Terminated: ok {rc=0} 01:52:42.382840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26025): Launched 01:52:42.704881 run osmo-hlr_10.42.42.2(pid=26026): Launched 01:52:42.827251 run osmo-stp_10.42.42.5: Starting osmo-stp 01:52:43.385118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26028): Launched 01:52:43.704997 run osmo-stp_10.42.42.5(pid=26029): Launched 01:52:43.826341 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:52:44.377755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26031): Launched 01:52:44.502307 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:52:44.772651 run patchelf(pid=26032): Launched 01:52:44.950584 run osmo-stp_10.42.42.5(pid=26029): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26029)] 01:52:45.086113 run osmo-stp_10.42.42.5(pid=26029): stdout: | (launched: 2022-12-14_01:52:43.645840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:45.223357 run osmo-stp_10.42.42.5(pid=26029): stderr: | [0;m[38;5;43m20221214015243834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015243834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015243834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015243834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015243835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015243835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015243835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:45.360828 run osmo-stp_10.42.42.5(pid=26029): stdout: | (launched: 2022-12-14_01:52:43.645840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:45.491564 run osmo-stp_10.42.42.5(pid=26029): stderr: | [0;m[38;5;43m20221214015243834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015243834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015243834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015243834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015243835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015243835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015243835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:45.646818 run patchelf(pid=26032): Terminating (SIGINT) 01:52:45.826529 run patchelf(pid=26032): Terminated: ok {rc=0} 01:52:45.963621 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26029): Process ended prematurely: osmo-stp_10.42.42.5(pid=26029) [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26029)] [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 01:52:45.974321 tst ping.py:22: Test FAILED (6.7 sec) 01:52:46.003664 run osmo-hlr_10.42.42.2(pid=26026): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26026)] 01:52:46.056875 run osmo-hlr_10.42.42.2(pid=26026): stdout: | (launched: 2022-12-14_01:52:42.645892) 01:52:46.111113 run osmo-hlr_10.42.42.2(pid=26026): stderr: | [0;m[1;31m20221214015242839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015242839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015242839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015242839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015242839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015242839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015242851 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015242860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015242860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015242860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:52:46.165768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26025): Terminating (SIGTERM) 01:52:46.208256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26028): Terminating (SIGTERM) 01:52:46.252008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26031): Terminating (SIGTERM) 01:52:46.296182 --- ParallelTerminationStrategy: PID 26025 died... 01:52:46.317978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26025): Terminated: ok {rc=0} 01:52:46.366682 --- ParallelTerminationStrategy: PID 26028 died... 01:52:46.388261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26028): Terminated: ok {rc=0} 01:52:46.436518 --- ParallelTerminationStrategy: PID 26031 died... 01:52:46.458028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26031): Terminated: ok {rc=0} 01:52:46.549551 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 01:52:47.636081 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:47.648369 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 01:52:47.716769 tst ping_idle_ping.py: using LAC 37725 01:52:47.833923 tst ping_idle_ping.py: using RAC 240 01:52:47.953014 tst ping_idle_ping.py: using CellId 37725 01:52:48.070194 tst ping_idle_ping.py: using BVCI 37726 01:52:48.180273 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:48.191466 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:48.202594 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:48.213632 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:48.224389 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:48.235401 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:48.246492 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 01:52:48.257514 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 01:52:48.371095 tst ping_idle_ping.py:24: start network... 01:52:48.570977 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:52:49.037069 run create_hlr_db(pid=26033): Launched 01:52:49.159289 bus /gobi_6: Setting Powered False 01:52:50.219405 run create_hlr_db(pid=26033): Terminated: ok {rc=0} 01:52:50.639089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26035): Launched 01:52:50.939031 run osmo-hlr_10.42.42.2(pid=26036): Launched 01:52:51.053065 run osmo-stp_10.42.42.5: Starting osmo-stp 01:52:51.567584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26038): Launched 01:52:51.866036 run osmo-stp_10.42.42.5(pid=26039): Launched 01:52:52.047566 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:52:52.560312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26041): Launched 01:52:52.675229 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:52:52.928223 run patchelf(pid=26042): Launched 01:52:53.095402 run osmo-stp_10.42.42.5(pid=26039): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26039)] 01:52:53.222418 run osmo-stp_10.42.42.5(pid=26039): stdout: | (launched: 2022-12-14_01:52:51.810581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:53.351037 run osmo-stp_10.42.42.5(pid=26039): stderr: | [0;m[38;5;43m20221214015251986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015251986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015251986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015251987 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015251987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015251987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015251987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:53.480582 run osmo-stp_10.42.42.5(pid=26039): stdout: | (launched: 2022-12-14_01:52:51.810581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:52:53.603234 run osmo-stp_10.42.42.5(pid=26039): stderr: | [0;m[38;5;43m20221214015251986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015251986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015251986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015251987 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015251987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015251987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015251987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:52:53.748325 run patchelf(pid=26042): Terminating (SIGINT) 01:52:53.915915 run patchelf(pid=26042): Terminated: ok {rc=0} 01:52:54.036313 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26039): Process ended prematurely: osmo-stp_10.42.42.5(pid=26039) [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26039)] [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 01:52:54.045326 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 01:52:54.072309 run osmo-hlr_10.42.42.2(pid=26036): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26036)] 01:52:54.119545 run osmo-hlr_10.42.42.2(pid=26036): stdout: | (launched: 2022-12-14_01:52:50.883572) 01:52:54.168564 run osmo-hlr_10.42.42.2(pid=26036): stderr: | [0;m[1;31m20221214015251056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015251056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015251056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015251056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015251056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015251056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015251068 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015251077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015251077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015251077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:52:54.217865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26035): Terminating (SIGTERM) 01:52:54.256920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26038): Terminating (SIGTERM) 01:52:54.296277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26041): Terminating (SIGTERM) 01:52:54.336695 --- ParallelTerminationStrategy: PID 26035 died... 01:52:54.355924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26035): Terminated: ok {rc=0} 01:52:54.399471 --- ParallelTerminationStrategy: PID 26038 died... 01:52:54.418304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26038): Terminated: ok {rc=0} 01:52:54.461949 --- ParallelTerminationStrategy: PID 26041 died... 01:52:54.480777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26041): Terminated: ok {rc=0} 01:52:54.566427 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 01:52:55.876250 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:52:55.883424 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 01:52:55.915019 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 01:52:55.953195 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 01:52:56.038628 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 01:52:56.070285 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 01:52:56.108011 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 01:52:56.709891 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 01:52:56.758094 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:56.769535 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:52:56.822687 tst cs_paging_gprs_active.py: using LAC 37726 01:52:56.941123 tst cs_paging_gprs_active.py: using RAC 241 01:52:57.056692 tst cs_paging_gprs_active.py: using CellId 37726 01:52:57.173423 tst cs_paging_gprs_active.py: using BVCI 37727 01:52:57.284034 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:57.295963 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:57.307403 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:57.318703 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:57.330005 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:57.341087 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:57.352500 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:57.363703 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:52:57.375241 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:52:57.496295 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:52:57.615332 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 01:52:57.833892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:58.159215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26046): Launched 01:52:58.440492 run iperf3-srv_10.42.42.10(pid=26047): Launched 01:52:58.561741 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 01:52:58.778893 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:52:59.102670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26048): Launched 01:52:59.385679 run iperf3-srv_10.42.42.10(pid=26049): Launched 01:52:59.507309 tst cs_paging_gprs_active.py:38: start network... 01:52:59.726474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:53:00.229835 run create_hlr_db(pid=26050): Launched 01:53:00.358207 bus /gobi_6: Setting Powered False 01:53:01.431943 run create_hlr_db(pid=26050): Terminated: ok {rc=0} 01:53:01.934230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26052): Launched 01:53:02.266864 run osmo-hlr_10.42.42.2(pid=26053): Launched 01:53:02.391498 run osmo-stp_10.42.42.5: Starting osmo-stp 01:53:02.951141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26055): Launched 01:53:03.275714 run osmo-stp_10.42.42.5(pid=26056): Launched 01:53:03.397828 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:53:03.957484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26058): Launched 01:53:04.082459 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:53:04.356101 run patchelf(pid=26059): Launched 01:53:04.535500 run osmo-stp_10.42.42.5(pid=26056): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26056)] 01:53:04.672472 run osmo-stp_10.42.42.5(pid=26056): stdout: | (launched: 2022-12-14_01:53:03.216882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:04.810764 run osmo-stp_10.42.42.5(pid=26056): stderr: | [0;m[38;5;43m20221214015303405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015303406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015303406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015303406 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015303407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015303407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015303407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:04.949370 run osmo-stp_10.42.42.5(pid=26056): stdout: | (launched: 2022-12-14_01:53:03.216882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:05.082085 run osmo-stp_10.42.42.5(pid=26056): stderr: | [0;m[38;5;43m20221214015303405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015303406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015303406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015303406 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015303407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015303407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015303407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:05.239556 run patchelf(pid=26059): Terminating (SIGINT) 01:53:05.420839 run patchelf(pid=26059): Terminated: ok {rc=0} 01:53:05.551778 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26056): Process ended prematurely: osmo-stp_10.42.42.5(pid=26056) [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26056)] [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 01:53:05.562227 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 01:53:05.590438 run osmo-hlr_10.42.42.2(pid=26053): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26053)] 01:53:05.641137 run osmo-hlr_10.42.42.2(pid=26053): stdout: | (launched: 2022-12-14_01:53:02.207962) 01:53:05.693312 run osmo-hlr_10.42.42.2(pid=26053): stderr: | [0;m[1;31m20221214015302406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015302406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015302406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015302406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015302406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015302406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015302419 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015302427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015302427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015302427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:53:05.745375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26046): Terminating (SIGTERM) 01:53:05.786782 run iperf3-srv_10.42.42.10(pid=26047): Terminating (SIGTERM) 01:53:05.828306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26048): Terminating (SIGTERM) 01:53:05.869844 run iperf3-srv_10.42.42.10(pid=26049): Terminating (SIGTERM) 01:53:05.911927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26052): Terminating (SIGTERM) 01:53:05.954353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26055): Terminating (SIGTERM) 01:53:05.996303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26058): Terminating (SIGTERM) 01:53:06.038198 --- ParallelTerminationStrategy: PID 26046 died... 01:53:06.058587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26046): Terminated: ok {rc=0} 01:53:06.104444 --- ParallelTerminationStrategy: PID 26047 died... 01:53:06.124184 run iperf3-srv_10.42.42.10(pid=26047): Terminated {rc=256} 01:53:06.170332 --- ParallelTerminationStrategy: PID 26048 died... 01:53:06.190137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26048): Terminated: ok {rc=0} 01:53:06.236114 --- ParallelTerminationStrategy: PID 26049 died... 01:53:06.255869 run iperf3-srv_10.42.42.10(pid=26049): Terminated {rc=256} 01:53:06.301980 --- ParallelTerminationStrategy: PID 26052 died... 01:53:06.321754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26052): Terminated: ok {rc=0} 01:53:06.367800 --- ParallelTerminationStrategy: PID 26055 died... 01:53:06.387506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26055): Terminated: ok {rc=0} 01:53:06.433547 --- ParallelTerminationStrategy: PID 26058 died... 01:53:06.453596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26058): Terminated: ok {rc=0} 01:53:06.541058 bus /gobi_0: Setting Powered False 01:53:07.639093 bus /gobi_0: Setting Powered False 01:53:08.753963 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 01:53:09.901734 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:09.914562 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:53:09.966568 tst iperf3.py: using LAC 37727 01:53:10.094612 tst iperf3.py: using RAC 242 01:53:10.220389 tst iperf3.py: using CellId 37727 01:53:10.346355 tst iperf3.py: using BVCI 37728 01:53:10.463022 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:10.475032 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:10.486817 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:10.498554 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:10.511020 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:10.523283 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:10.535585 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:10.547686 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:10.560379 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:53:10.679550 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 01:53:10.881424 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:53:11.182823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26061): Launched 01:53:11.444079 run iperf3-srv_10.42.42.10(pid=26062): Launched 01:53:11.556310 tst iperf3.py:8: start network... 01:53:11.757547 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:53:12.221573 run create_hlr_db(pid=26063): Launched 01:53:12.345562 bus /gobi_6: Setting Powered False 01:53:13.409222 run create_hlr_db(pid=26063): Terminated: ok {rc=0} 01:53:13.841645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26065): Launched 01:53:14.143056 run osmo-hlr_10.42.42.2(pid=26066): Launched 01:53:14.255426 run osmo-stp_10.42.42.5: Starting osmo-stp 01:53:14.770449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26068): Launched 01:53:15.071201 run osmo-stp_10.42.42.5(pid=26069): Launched 01:53:15.183961 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:53:15.700189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26071): Launched 01:53:15.814768 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:53:16.111271 run patchelf(pid=26072): Launched 01:53:16.308108 run osmo-stp_10.42.42.5(pid=26069): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26069)] 01:53:16.449567 run osmo-stp_10.42.42.5(pid=26069): stdout: | (launched: 2022-12-14_01:53:15.015160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:16.594276 run osmo-stp_10.42.42.5(pid=26069): stderr: | [0;m[38;5;43m20221214015315185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015315185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015315185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015315186 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015315186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015315186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015315186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:16.737946 run osmo-stp_10.42.42.5(pid=26069): stdout: | (launched: 2022-12-14_01:53:15.015160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:16.874948 run osmo-stp_10.42.42.5(pid=26069): stderr: | [0;m[38;5;43m20221214015315185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015315185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015315185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015315186 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015315186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015315186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015315186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:17.036898 run patchelf(pid=26072): Terminating (SIGINT) 01:53:17.223359 run patchelf(pid=26072): Terminated: ok {rc=0} 01:53:17.354232 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26069): Process ended prematurely: osmo-stp_10.42.42.5(pid=26069) [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26069)] [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 01:53:17.365083 tst iperf3.py:8: Test FAILED (7.5 sec) 01:53:17.393681 run osmo-hlr_10.42.42.2(pid=26066): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26066)] 01:53:17.444593 run osmo-hlr_10.42.42.2(pid=26066): stdout: | (launched: 2022-12-14_01:53:14.087787) 01:53:17.497075 run osmo-hlr_10.42.42.2(pid=26066): stderr: | [0;m[1;31m20221214015314260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015314260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015314260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015314260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015314260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015314260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015314285 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015314294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015314294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015314294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:53:17.550102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26061): Terminating (SIGTERM) 01:53:17.592329 run iperf3-srv_10.42.42.10(pid=26062): Terminating (SIGTERM) 01:53:17.634421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26065): Terminating (SIGTERM) 01:53:17.676392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26068): Terminating (SIGTERM) 01:53:17.718759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26071): Terminating (SIGTERM) 01:53:17.761228 --- ParallelTerminationStrategy: PID 26061 died... 01:53:17.781448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26061): Terminated: ok {rc=0} 01:53:17.828046 --- ParallelTerminationStrategy: PID 26062 died... 01:53:17.847851 run iperf3-srv_10.42.42.10(pid=26062): Terminated {rc=256} 01:53:17.893914 --- ParallelTerminationStrategy: PID 26065 died... 01:53:17.913799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26065): Terminated: ok {rc=0} 01:53:17.960163 --- ParallelTerminationStrategy: PID 26068 died... 01:53:17.980168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26068): Terminated: ok {rc=0} 01:53:18.026608 --- ParallelTerminationStrategy: PID 26071 died... 01:53:18.046599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26071): Terminated: ok {rc=0} 01:53:18.135585 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 01:53:19.281922 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:19.294146 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:53:19.343713 tst iperf3m4.py: using LAC 37728 01:53:19.470564 tst iperf3m4.py: using RAC 243 01:53:19.597680 tst iperf3m4.py: using CellId 37728 01:53:19.726104 tst iperf3m4.py: using BVCI 37729 01:53:19.842999 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:19.855017 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:19.866760 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:19.878519 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:19.890573 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:19.902617 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:19.914907 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:19.926823 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:19.939041 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:53:20.054747 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:53:20.177169 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:53:20.292355 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:53:20.411105 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 01:53:20.629965 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:53:20.952868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26073): Launched 01:53:21.233355 run iperf3-srv_10.42.42.10(pid=26074): Launched 01:53:21.354187 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 01:53:21.570781 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:53:21.895129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26075): Launched 01:53:22.178019 run iperf3-srv_10.42.42.10(pid=26076): Launched 01:53:22.300032 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 01:53:22.516702 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:53:22.839542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26077): Launched 01:53:23.122825 run iperf3-srv_10.42.42.10(pid=26078): Launched 01:53:23.245875 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 01:53:23.462572 run iperf3-srv_10.42.42.10: Starting iperf3-srv 01:53:23.786406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26079): Launched 01:53:24.068299 run iperf3-srv_10.42.42.10(pid=26080): Launched 01:53:24.189528 tst iperf3m4.py:8: start network... 01:53:24.406344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:53:24.904738 run create_hlr_db(pid=26081): Launched 01:53:25.027595 bus /gobi_6: Setting Powered False 01:53:26.091804 run create_hlr_db(pid=26081): Terminated: ok {rc=0} 01:53:26.542345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26083): Launched 01:53:26.865233 run osmo-hlr_10.42.42.2(pid=26084): Launched 01:53:26.987269 run osmo-stp_10.42.42.5: Starting osmo-stp 01:53:27.545034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26086): Launched 01:53:27.870090 run osmo-stp_10.42.42.5(pid=26087): Launched 01:53:27.992819 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:53:28.551603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26089): Launched 01:53:28.676242 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:53:28.949608 run patchelf(pid=26090): Launched 01:53:29.130234 run osmo-stp_10.42.42.5(pid=26087): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26087)] 01:53:29.267223 run osmo-stp_10.42.42.5(pid=26087): stdout: | (launched: 2022-12-14_01:53:27.810122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:29.406961 run osmo-stp_10.42.42.5(pid=26087): stderr: | [0;m[38;5;43m20221214015327998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015327998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015327999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015327999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015328000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015328000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015328000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:29.546592 run osmo-stp_10.42.42.5(pid=26087): stdout: | (launched: 2022-12-14_01:53:27.810122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:29.679145 run osmo-stp_10.42.42.5(pid=26087): stderr: | [0;m[38;5;43m20221214015327998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015327998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015327999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015327999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015328000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015328000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015328000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:29.836447 run patchelf(pid=26090): Terminating (SIGINT) 01:53:30.018492 run patchelf(pid=26090): Terminated: ok {rc=0} 01:53:30.150447 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26087): Process ended prematurely: osmo-stp_10.42.42.5(pid=26087) [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26087)] [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 01:53:30.160764 tst iperf3m4.py:8: Test FAILED (10.9 sec) 01:53:30.189573 run osmo-hlr_10.42.42.2(pid=26084): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26084)] 01:53:30.239754 run osmo-hlr_10.42.42.2(pid=26084): stdout: | (launched: 2022-12-14_01:53:26.805437) 01:53:30.291225 run osmo-hlr_10.42.42.2(pid=26084): stderr: | [0;m[1;31m20221214015327000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015327000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015327000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015327000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015327000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015327000 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015327013 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015327021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015327021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015327021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:53:30.343645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26073): Terminating (SIGTERM) 01:53:30.385073 run iperf3-srv_10.42.42.10(pid=26074): Terminating (SIGTERM) 01:53:30.426527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26075): Terminating (SIGTERM) 01:53:30.468519 run iperf3-srv_10.42.42.10(pid=26076): Terminating (SIGTERM) 01:53:30.510049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26077): Terminating (SIGTERM) 01:53:30.552188 run iperf3-srv_10.42.42.10(pid=26078): Terminating (SIGTERM) 01:53:30.593716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26079): Terminating (SIGTERM) 01:53:30.635205 run iperf3-srv_10.42.42.10(pid=26080): Terminating (SIGTERM) 01:53:30.676351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26083): Terminating (SIGTERM) 01:53:30.718548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26086): Terminating (SIGTERM) 01:53:30.760101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26089): Terminating (SIGTERM) 01:53:30.802262 --- ParallelTerminationStrategy: PID 26073 died... 01:53:30.822310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26073): Terminated: ok {rc=0} 01:53:30.884690 --- ParallelTerminationStrategy: PID 26074 died... 01:53:30.905364 run iperf3-srv_10.42.42.10(pid=26074): Terminated {rc=256} 01:53:30.952874 --- ParallelTerminationStrategy: PID 26075 died... 01:53:30.974051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26075): Terminated: ok {rc=0} 01:53:31.022129 --- ParallelTerminationStrategy: PID 26076 died... 01:53:31.043838 run iperf3-srv_10.42.42.10(pid=26076): Terminated {rc=256} 01:53:31.092319 --- ParallelTerminationStrategy: PID 26077 died... 01:53:31.113745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26077): Terminated: ok {rc=0} 01:53:31.161937 --- ParallelTerminationStrategy: PID 26078 died... 01:53:31.183105 run iperf3-srv_10.42.42.10(pid=26078): Terminated {rc=256} 01:53:31.231286 --- ParallelTerminationStrategy: PID 26079 died... 01:53:31.252638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26079): Terminated: ok {rc=0} 01:53:31.301083 --- ParallelTerminationStrategy: PID 26080 died... 01:53:31.322558 run iperf3-srv_10.42.42.10(pid=26080): Terminated {rc=256} 01:53:31.370775 --- ParallelTerminationStrategy: PID 26083 died... 01:53:31.392375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26083): Terminated: ok {rc=0} 01:53:31.440718 --- ParallelTerminationStrategy: PID 26086 died... 01:53:31.462279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26086): Terminated: ok {rc=0} 01:53:31.510431 --- ParallelTerminationStrategy: PID 26089 died... 01:53:31.531991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26089): Terminated: ok {rc=0} 01:53:31.623344 bus /gobi_4: Setting Powered False 01:53:32.721613 bus /gobi_4: Setting Powered False 01:53:33.836090 bus /gobi_1: Setting Powered False 01:53:34.933290 bus /gobi_1: Setting Powered False 01:53:36.047831 bus /gobi_0: Setting Powered False 01:53:37.145990 bus /gobi_0: Setting Powered False 01:53:38.260216 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 01:53:39.362443 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:39.374607 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:53:39.424925 tst ping.py: using LAC 37729 01:53:39.549682 tst ping.py: using RAC 244 01:53:39.675324 tst ping.py: using CellId 37729 01:53:39.799608 tst ping.py: using BVCI 37730 01:53:39.914046 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:39.926180 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:39.937996 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:39.949842 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:39.961954 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:39.974153 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:39.986362 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:39.998388 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:53:40.113901 tst ping.py:19: start network... 01:53:40.311379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:53:40.771038 run create_hlr_db(pid=26091): Launched 01:53:40.892889 bus /gobi_6: Setting Powered False 01:53:41.952776 run create_hlr_db(pid=26091): Terminated: ok {rc=0} 01:53:42.389312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26093): Launched 01:53:42.707513 run osmo-hlr_10.42.42.2(pid=26094): Launched 01:53:42.827443 run osmo-stp_10.42.42.5: Starting osmo-stp 01:53:43.379179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26096): Launched 01:53:43.697463 run osmo-stp_10.42.42.5(pid=26097): Launched 01:53:43.818613 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:53:44.369855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26099): Launched 01:53:44.493143 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:53:44.762172 run patchelf(pid=26100): Launched 01:53:44.939784 run osmo-stp_10.42.42.5(pid=26097): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26097)] 01:53:45.073980 run osmo-stp_10.42.42.5(pid=26097): stdout: | (launched: 2022-12-14_01:53:43.638421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:45.210194 run osmo-stp_10.42.42.5(pid=26097): stderr: | [0;m[38;5;43m20221214015343825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015343826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015343826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015343826 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015343827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015343827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015343827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:45.346119 run osmo-stp_10.42.42.5(pid=26097): stdout: | (launched: 2022-12-14_01:53:43.638421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:45.475731 run osmo-stp_10.42.42.5(pid=26097): stderr: | [0;m[38;5;43m20221214015343825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015343826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015343826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015343826 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015343827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015343827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015343827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:45.629769 run patchelf(pid=26100): Terminating (SIGINT) 01:53:45.807045 run patchelf(pid=26100): Terminated: ok {rc=0} 01:53:45.947416 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26097): Process ended prematurely: osmo-stp_10.42.42.5(pid=26097) [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26097)] [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 01:53:45.957421 tst ping.py:22: Test FAILED (6.6 sec) 01:53:45.985999 run osmo-hlr_10.42.42.2(pid=26094): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26094)] 01:53:46.037848 run osmo-hlr_10.42.42.2(pid=26094): stdout: | (launched: 2022-12-14_01:53:42.648728) 01:53:46.091754 run osmo-hlr_10.42.42.2(pid=26094): stderr: | [0;m[1;31m20221214015342842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015342842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015342842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015342842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015342842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015342842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015342854 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015342862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015342862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015342863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:53:46.145826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26093): Terminating (SIGTERM) 01:53:46.189072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26096): Terminating (SIGTERM) 01:53:46.234066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26099): Terminating (SIGTERM) 01:53:46.277743 --- ParallelTerminationStrategy: PID 26093 died... 01:53:46.298515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26093): Terminated: ok {rc=0} 01:53:46.346465 --- ParallelTerminationStrategy: PID 26096 died... 01:53:46.367363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26096): Terminated: ok {rc=0} 01:53:46.415211 --- ParallelTerminationStrategy: PID 26099 died... 01:53:46.436032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26099): Terminated: ok {rc=0} 01:53:46.525930 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 01:53:47.617764 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:47.630438 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 01:53:47.683656 tst ping_idle_ping.py: using LAC 37730 01:53:47.808238 tst ping_idle_ping.py: using RAC 245 01:53:47.932903 tst ping_idle_ping.py: using CellId 37730 01:53:48.056777 tst ping_idle_ping.py: using BVCI 37731 01:53:48.172028 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:48.183979 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:48.195763 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:48.207575 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:48.219574 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:48.231531 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:48.243641 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 01:53:48.255821 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 01:53:48.371676 tst ping_idle_ping.py:24: start network... 01:53:48.570030 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:53:49.068117 run create_hlr_db(pid=26102): Launched 01:53:49.189514 bus /gobi_6: Setting Powered False 01:53:50.253102 run create_hlr_db(pid=26102): Terminated: ok {rc=0} 01:53:50.697760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26104): Launched 01:53:51.016455 run osmo-hlr_10.42.42.2(pid=26105): Launched 01:53:51.139544 run osmo-stp_10.42.42.5: Starting osmo-stp 01:53:51.690145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26107): Launched 01:53:52.009019 run osmo-stp_10.42.42.5(pid=26108): Launched 01:53:52.130283 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:53:52.677612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26110): Launched 01:53:52.801078 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:53:53.070296 run patchelf(pid=26111): Launched 01:53:53.249459 run osmo-stp_10.42.42.5(pid=26108): ERR: Terminated: ERROR {rc=1} [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26108)] 01:53:53.383825 run osmo-stp_10.42.42.5(pid=26108): stdout: | (launched: 2022-12-14_01:53:51.950120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:53.520079 run osmo-stp_10.42.42.5(pid=26108): stderr: | [0;m[38;5;43m20221214015352139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015352139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015352139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015352140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015352140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015352140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015352140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:53.656309 run osmo-stp_10.42.42.5(pid=26108): stdout: | (launched: 2022-12-14_01:53:51.950120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:53:53.786517 run osmo-stp_10.42.42.5(pid=26108): stderr: | [0;m[38;5;43m20221214015352139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015352139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015352139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015352140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015352140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015352140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015352140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:53:53.941036 run patchelf(pid=26111): Terminating (SIGINT) 01:53:54.118988 run patchelf(pid=26111): Terminated: ok {rc=0} 01:53:54.247228 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26108): Process ended prematurely: osmo-stp_10.42.42.5(pid=26108) [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26108)] [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 01:53:54.256904 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 01:53:54.284931 run osmo-hlr_10.42.42.2(pid=26105): ERR: Terminated: ERROR {rc=237} [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26105)] 01:53:54.335289 run osmo-hlr_10.42.42.2(pid=26105): stdout: | (launched: 2022-12-14_01:53:50.957915) 01:53:54.387210 run osmo-hlr_10.42.42.2(pid=26105): stderr: | [0;m[1;31m20221214015351151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015351151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015351152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015351152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015351152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015351152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015351165 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015351174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015351174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015351174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:53:54.439519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26104): Terminating (SIGTERM) 01:53:54.481376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26107): Terminating (SIGTERM) 01:53:54.523795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26110): Terminating (SIGTERM) 01:53:54.565956 --- ParallelTerminationStrategy: PID 26104 died... 01:53:54.586267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26104): Terminated: ok {rc=0} 01:53:54.632448 --- ParallelTerminationStrategy: PID 26107 died... 01:53:54.652262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26107): Terminated: ok {rc=0} 01:53:54.698094 --- ParallelTerminationStrategy: PID 26110 died... 01:53:54.717940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26110): Terminated: ok {rc=0} 01:53:54.805625 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 01:53:56.130554 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:53:56.139458 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 01:53:56.171462 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 01:53:56.205358 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 01:53:56.257498 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 01:53:56.289398 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 01:53:56.323496 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 01:53:56.889724 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2397 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 01:53:56.896424 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:53:56.909360 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 01:53:56.982322 tst switch_tch_pdch.py: using LAC 37731 01:53:57.106324 tst switch_tch_pdch.py: using RAC 246 01:53:57.229396 tst switch_tch_pdch.py: using CellId 37731 01:53:57.354386 tst switch_tch_pdch.py: using BVCI 37732 01:53:57.470549 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:53:57.482562 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:53:57.495017 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:53:57.507124 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:53:57.519928 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:53:57.532620 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:53:57.545671 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 01:53:57.558514 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:53:57.676827 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 01:53:57.792769 tst switch_tch_pdch.py:51: start network... 01:53:57.990671 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:53:58.447660 run create_hlr_db(pid=26115): Launched 01:53:58.569272 bus /gobi_6: Setting Powered False 01:53:59.628791 run create_hlr_db(pid=26115): Terminated: ok {rc=0} 01:54:00.062633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26117): Launched 01:54:00.380215 run osmo-hlr_10.42.42.2(pid=26118): Launched 01:54:00.501336 run osmo-stp_10.42.42.5: Starting osmo-stp 01:54:01.066681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26120): Launched 01:54:01.422218 run osmo-stp_10.42.42.5(pid=26131): Launched 01:54:01.622291 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:54:02.430820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26173): Launched 01:54:02.567392 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:54:02.858796 run patchelf(pid=26186): Launched 01:54:03.069638 run osmo-stp_10.42.42.5(pid=26131): ERR: Terminated: ERROR {rc=1} [trial-2397↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26131)] 01:54:03.225434 run osmo-stp_10.42.42.5(pid=26131): stdout: | (launched: 2022-12-14_01:54:01.347295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:03.375316 run osmo-stp_10.42.42.5(pid=26131): stderr: | [0;m[38;5;43m20221214015401704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015401704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015401713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015401713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015401714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015401714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015401714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:03.532356 run osmo-stp_10.42.42.5(pid=26131): stdout: | (launched: 2022-12-14_01:54:01.347295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:03.689673 run osmo-stp_10.42.42.5(pid=26131): stderr: | [0;m[38;5;43m20221214015401704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015401704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015401713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015401713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015401714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015401714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015401714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:03.882395 run patchelf(pid=26186): Terminating (SIGINT) 01:54:04.093642 run patchelf(pid=26186): Terminated: ok {rc=0} 01:54:04.252211 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26131): Process ended prematurely: osmo-stp_10.42.42.5(pid=26131) [trial-2397↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26131)] [trial-2397↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 01:54:04.265841 tst switch_tch_pdch.py:54: Test FAILED (7.4 sec) 01:54:04.302812 run osmo-hlr_10.42.42.2(pid=26118): ERR: Terminated: ERROR {rc=237} [trial-2397↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26118)] 01:54:04.366160 run osmo-hlr_10.42.42.2(pid=26118): stdout: | (launched: 2022-12-14_01:54:00.322152) 01:54:04.427072 run osmo-hlr_10.42.42.2(pid=26118): stderr: | [0;m[1;31m20221214015400514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015400514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015400515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015400515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015400515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015400515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015400527 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015400535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015400535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015400535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:04.498687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26117): Terminating (SIGTERM) 01:54:04.547840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26120): Terminating (SIGTERM) 01:54:04.601379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26173): Terminating (SIGTERM) 01:54:04.655298 --- ParallelTerminationStrategy: PID 26117 died... 01:54:04.679484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26117): Terminated: ok {rc=0} 01:54:04.744402 --- ParallelTerminationStrategy: PID 26120 died... 01:54:04.769374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26120): Terminated: ok {rc=0} 01:54:04.831762 --- ParallelTerminationStrategy: PID 26173 died... 01:54:04.859750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26173): Terminated: ok {rc=0} 01:54:04.983220 bus /gobi_0: Setting Powered False 01:54:06.100613 bus /gobi_0: Setting Powered False 01:54:07.219253 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2397 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 nitb_smpp --------------------------------------------------------------------- 01:54:08.476934 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:54:08.480210 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 01:54:08.501661 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 01:54:08.509306 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 01:54:08.545340 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 01:54:08.567669 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 01:54:08.574796 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 01:54:09.092418 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2397 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 01:54:09.099107 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 01:54:09.118532 tst esme_connect_policy_acceptall.py: using MSISDN 8438 01:54:09.258884 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:54:09.844328 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26423): Launched 01:54:10.171527 run osmo-nitb_10.42.42.2(pid=26424): Launched 01:54:10.373452 run osmo-nitb_10.42.42.2(pid=26424): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26424)] 01:54:10.522900 run osmo-nitb_10.42.42.2(pid=26424): stdout: | (launched: 2022-12-14_01:54:10.114115) 01:54:10.673940 run osmo-nitb_10.42.42.2(pid=26424): stderr: | (launched: 2022-12-14_01:54:10.160584) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:54:10.825106 run osmo-nitb_10.42.42.2(pid=26424): stdout: | (launched: 2022-12-14_01:54:10.114115) 01:54:10.969897 run osmo-nitb_10.42.42.2(pid=26424): stderr: | (launched: 2022-12-14_01:54:10.160584) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8b7301f268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26424): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26424) [trial-2397↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26424)] 01:54:11.315787 tst osmo-nitb_10.42.42.2(pid=26424): stdout: | (launched: 2022-12-14_01:54:10.114115) 01:54:11.452488 tst osmo-nitb_10.42.42.2(pid=26424): stderr: | (launched: 2022-12-14_01:54:10.160584) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:54:11.614163 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=26424): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26424) [trial-2397↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26424)] [trial-2397↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 01:54:11.624094 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 01:54:11.632545 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26423): Terminating (SIGTERM) 01:54:11.847473 --- ParallelTerminationStrategy: PID 26423 died... 01:54:11.870182 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26423): Terminated: ok {rc=0} ---------------------------------------------- trial-2397 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 01:54:11.926170 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 01:54:11.948431 tst esme_connect_policy_closed.py: using MSISDN 8439 01:54:12.072429 tst esme_connect_policy_closed.py: using MSISDN 8440 01:54:12.186341 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:54:12.767069 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26425): Launched 01:54:13.092062 run osmo-nitb_10.42.42.2(pid=26426): Launched 01:54:13.279774 run osmo-nitb_10.42.42.2(pid=26426): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26426)] 01:54:13.408021 run osmo-nitb_10.42.42.2(pid=26426): stdout: | (launched: 2022-12-14_01:54:13.033612) 01:54:13.537990 run osmo-nitb_10.42.42.2(pid=26426): stderr: | (launched: 2022-12-14_01:54:13.080727) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:54:13.668690 run osmo-nitb_10.42.42.2(pid=26426): stdout: | (launched: 2022-12-14_01:54:13.033612) 01:54:13.792710 run osmo-nitb_10.42.42.2(pid=26426): stderr: | (launched: 2022-12-14_01:54:13.080727) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:54:13.941642 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=26426): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26426) [trial-2397↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26426)] [trial-2397↪nitb_smpp↪esme_connect_policy_closed.py:24] 01:54:13.950968 tst esme_connect_policy_closed.py:24: Test FAILED (2.0 sec) 01:54:13.958509 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26425): Terminating (SIGTERM) 01:54:14.168876 --- ParallelTerminationStrategy: PID 26425 died... 01:54:14.190506 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26425): Terminated: ok {rc=0} ---------------------------------------------- trial-2397 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 01:54:14.242532 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 01:54:14.254843 tst nitb_smpp: Using 1 x bts (candidates: 1) 01:54:14.291729 tst esme_ms_sms_storeforward.py: using LAC 37732 01:54:14.417832 tst esme_ms_sms_storeforward.py: using RAC 247 01:54:14.542700 tst esme_ms_sms_storeforward.py: using CellId 37732 01:54:14.667550 tst esme_ms_sms_storeforward.py: using BVCI 37733 01:54:14.783128 tst nitb_smpp: Using 1 x modem (candidates: 1) 01:54:14.914398 tst esme_ms_sms_storeforward.py: using MSISDN 8441 01:54:15.027282 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 01:54:15.240567 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:54:15.912127 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26427): Launched 01:54:16.277670 run osmo-nitb_10.42.42.2(pid=26428): Launched 01:54:16.505314 run osmo-nitb_10.42.42.2(pid=26428): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26428)] 01:54:16.659524 run osmo-nitb_10.42.42.2(pid=26428): stdout: | (launched: 2022-12-14_01:54:16.209297) 01:54:16.817457 run osmo-nitb_10.42.42.2(pid=26428): stderr: | (launched: 2022-12-14_01:54:16.264267) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:54:16.974064 run osmo-nitb_10.42.42.2(pid=26428): stdout: | (launched: 2022-12-14_01:54:16.209297) 01:54:17.124146 run osmo-nitb_10.42.42.2(pid=26428): stderr: | (launched: 2022-12-14_01:54:16.264267) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:54:17.300436 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=26428): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26428) [trial-2397↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26428)] [trial-2397↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 01:54:17.313059 tst esme_ms_sms_storeforward.py:23: Test FAILED (3.1 sec) 01:54:17.321757 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26427): Terminating (SIGTERM) 01:54:17.538569 --- ParallelTerminationStrategy: PID 26427 died... 01:54:17.568426 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26427): Terminated: ok {rc=0} 01:54:17.703094 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 01:54:18.795409 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 01:54:18.809572 tst nitb_smpp: Using 1 x bts (candidates: 1) 01:54:18.854270 tst esme_ms_sms_transaction.py: using LAC 37733 01:54:18.987236 tst esme_ms_sms_transaction.py: using RAC 248 01:54:19.118634 tst esme_ms_sms_transaction.py: using CellId 37733 01:54:19.253632 tst esme_ms_sms_transaction.py: using BVCI 37734 01:54:19.378541 tst nitb_smpp: Using 1 x modem (candidates: 1) 01:54:19.508868 tst esme_ms_sms_transaction.py: using MSISDN 8442 01:54:19.620258 tst esme_ms_sms_transaction.py:18: start nitb and bts... 01:54:19.829203 run osmo-nitb_10.42.42.2: Starting osmo-nitb 01:54:20.462263 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26429): Launched 01:54:20.783562 run osmo-nitb_10.42.42.2(pid=26430): Launched 01:54:20.975266 run osmo-nitb_10.42.42.2(pid=26430): ERR: Terminated: ERROR {rc=2} [trial-2397↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26430)] 01:54:21.114600 run osmo-nitb_10.42.42.2(pid=26430): stdout: | (launched: 2022-12-14_01:54:20.726651) 01:54:21.255569 run osmo-nitb_10.42.42.2(pid=26430): stderr: | (launched: 2022-12-14_01:54:20.772312) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:54:21.397411 run osmo-nitb_10.42.42.2(pid=26430): stdout: | (launched: 2022-12-14_01:54:20.726651) 01:54:21.532073 run osmo-nitb_10.42.42.2(pid=26430): stderr: | (launched: 2022-12-14_01:54:20.772312) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8b7301f268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26430): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26430) [trial-2397↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26430)] 01:54:21.920546 tst osmo-nitb_10.42.42.2(pid=26430): stdout: | (launched: 2022-12-14_01:54:20.726651) 01:54:22.048524 tst osmo-nitb_10.42.42.2(pid=26430): stderr: | (launched: 2022-12-14_01:54:20.772312) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 01:54:22.200046 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=26430): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26430) [trial-2397↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26430)] [trial-2397↪nitb_smpp↪esme_ms_sms_transaction.py:21] 01:54:22.209638 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 01:54:22.217260 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26429): Terminating (SIGTERM) 01:54:22.427606 --- ParallelTerminationStrategy: PID 26429 died... 01:54:22.449832 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26429): Terminated: ok {rc=0} 01:54:22.538252 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 smpp --------------------------------------------------------------------- 01:54:23.707205 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:54:23.711155 tst smpp: Verifying 1 x bts (candidates: 11) 01:54:23.732669 tst smpp: Verifying 6 x ip_address (candidates: 9) 01:54:23.762229 tst smpp: Verifying 1 x modem (candidates: 12) 01:54:23.797636 tst smpp: Reserving 1 x bts (candidates: 11) 01:54:23.820667 tst smpp: Reserving 6 x ip_address (candidates: 9) 01:54:23.848243 tst smpp: Reserving 1 x modem (candidates: 12) 01:54:24.373151 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2397 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 01:54:24.379724 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:24.391168 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:24.403725 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:24.415156 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:24.435152 tst esme_connect_policy_acceptall.py: using MSISDN 8443 01:54:24.554702 run osmo-stp_10.42.42.4: Starting osmo-stp 01:54:25.103172 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26434): Launched 01:54:25.449095 run osmo-stp_10.42.42.4(pid=26435): Launched 01:54:25.690562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:54:26.207193 run create_hlr_db(pid=26436): Launched 01:54:26.367308 bus /sierra_2: Setting Powered False 01:54:27.431515 run create_hlr_db(pid=26436): Terminated: ok {rc=0} 01:54:27.870987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26439): Launched 01:54:28.176375 run osmo-hlr_10.42.42.2(pid=26440): Launched 01:54:28.294113 run osmo-msc_10.42.42.5: Starting osmo-msc 01:54:28.849586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26442): Launched 01:54:29.157185 run osmo-msc_10.42.42.5(pid=26443): Launched 01:54:29.328359 run osmo-hlr_10.42.42.2(pid=26440): ERR: Terminated: ERROR {rc=237} [trial-2397↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26440)] 01:54:29.459136 run osmo-hlr_10.42.42.2(pid=26440): stdout: | (launched: 2022-12-14_01:54:28.119430) 01:54:29.588220 run osmo-hlr_10.42.42.2(pid=26440): stderr: | [0;m[1;31m20221214015428292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015428292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015428292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015428292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015428292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015428292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015428305 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015428313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015428313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015428313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:29.714795 run osmo-hlr_10.42.42.2(pid=26440): stdout: | (launched: 2022-12-14_01:54:28.119430) 01:54:29.835912 run osmo-hlr_10.42.42.2(pid=26440): stderr: | [0;m[1;31m20221214015428292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015428292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015428292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015428292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015428292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015428292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015428305 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015428313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015428313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015428313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:29.980851 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=26440): Process ended prematurely: osmo-hlr_10.42.42.2(pid=26440) [trial-2397↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26440)] [trial-2397↪smpp↪esme_connect_policy_acceptall.py:23] 01:54:29.989165 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.6 sec) 01:54:30.015108 run osmo-msc_10.42.42.5(pid=26443): ERR: Terminated: ERROR {rc=9} [trial-2397↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=26443)] 01:54:30.062422 run osmo-msc_10.42.42.5(pid=26443): stdout: | (launched: 2022-12-14_01:54:29.099370) 01:54:30.111484 run osmo-msc_10.42.42.5(pid=26443): stderr: | [0;m[38;5;43m20221214015429416 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221214015429416 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221214015429416 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221214015429416 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221214015429416 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221214015429416 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221214015429416 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221214015429416 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221214015429417 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 01:54:30.160569 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26434): Terminating (SIGTERM) 01:54:30.200137 run osmo-stp_10.42.42.4(pid=26435): Terminating (SIGTERM) 01:54:30.239579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26439): Terminating (SIGTERM) 01:54:30.280194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26442): Terminating (SIGTERM) 01:54:30.321164 --- ParallelTerminationStrategy: PID 26434 died... 01:54:30.340134 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26434): Terminated: ok {rc=0} 01:54:30.384467 --- ParallelTerminationStrategy: PID 26435 died... 01:54:30.402980 run osmo-stp_10.42.42.4(pid=26435): Terminated: ok {rc=0} 01:54:30.446209 --- ParallelTerminationStrategy: PID 26439 died... 01:54:30.464621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26439): Terminated: ok {rc=0} 01:54:30.508019 --- ParallelTerminationStrategy: PID 26442 died... 01:54:30.526455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26442): Terminated: ok {rc=0} ---------------------------------------------- trial-2397 smpp esme_connect_policy_closed.py ---------------------------------------------- 01:54:30.574622 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:30.585821 tst smpp: Using 1 x bts (candidates: 1) 01:54:30.621374 tst esme_connect_policy_closed.py: using LAC 37734 01:54:30.751782 tst esme_connect_policy_closed.py: using RAC 249 01:54:30.902558 tst esme_connect_policy_closed.py: using CellId 37734 01:54:31.060522 tst esme_connect_policy_closed.py: using BVCI 37735 01:54:31.175459 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:31.187255 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:31.198717 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:31.219116 tst esme_connect_policy_closed.py: using MSISDN 8444 01:54:31.354520 tst esme_connect_policy_closed.py: using MSISDN 8445 01:54:31.479295 run osmo-stp_10.42.42.4: Starting osmo-stp 01:54:32.043053 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26446): Launched 01:54:32.383259 run osmo-stp_10.42.42.4(pid=26447): Launched 01:54:32.510068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:54:33.017566 run create_hlr_db(pid=26448): Launched 01:54:34.200716 run create_hlr_db(pid=26448): Terminated: ok {rc=0} 01:54:34.546232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26450): Launched 01:54:34.875381 run osmo-hlr_10.42.42.2(pid=26451): Launched 01:54:35.001658 run osmo-msc_10.42.42.5: Starting osmo-msc 01:54:35.603529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26453): Launched 01:54:35.934687 run osmo-msc_10.42.42.5(pid=26454): Launched 01:54:36.119400 run osmo-hlr_10.42.42.2(pid=26451): ERR: Terminated: ERROR {rc=237} [trial-2397↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26451)] 01:54:36.265676 run osmo-hlr_10.42.42.2(pid=26451): stdout: | (launched: 2022-12-14_01:54:34.815008) 01:54:36.416361 run osmo-hlr_10.42.42.2(pid=26451): stderr: | [0;m[1;31m20221214015435009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015435009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015435009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015435009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015435009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015435009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015435031 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015435040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015435041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015435041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:36.554173 run osmo-hlr_10.42.42.2(pid=26451): stdout: | (launched: 2022-12-14_01:54:34.815008) 01:54:36.685469 run osmo-hlr_10.42.42.2(pid=26451): stderr: | [0;m[1;31m20221214015435009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015435009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015435009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015435009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015435009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015435009 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015435031 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015435040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015435041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015435041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:36.842085 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=26451): Process ended prematurely: osmo-hlr_10.42.42.2(pid=26451) [trial-2397↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26451)] [trial-2397↪smpp↪esme_connect_policy_closed.py:31] 01:54:36.851126 tst esme_connect_policy_closed.py:31: Test FAILED (6.3 sec) 01:54:36.878484 run osmo-msc_10.42.42.5(pid=26454): ERR: Terminated: ERROR {rc=9} [trial-2397↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=26454)] 01:54:36.929675 run osmo-msc_10.42.42.5(pid=26454): stdout: | (launched: 2022-12-14_01:54:35.873804) 01:54:36.981830 run osmo-msc_10.42.42.5(pid=26454): stderr: | [0;m[38;5;43m20221214015436255 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221214015436255 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221214015436255 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221214015436255 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221214015436255 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221214015436255 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221214015436255 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221214015436256 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221214015436256 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 01:54:37.033999 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26446): Terminating (SIGTERM) 01:54:37.076134 run osmo-stp_10.42.42.4(pid=26447): Terminating (SIGTERM) 01:54:37.119291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26450): Terminating (SIGTERM) 01:54:37.163377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26453): Terminating (SIGTERM) 01:54:37.208416 --- ParallelTerminationStrategy: PID 26446 died... 01:54:37.229561 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26446): Terminated: ok {rc=0} 01:54:37.277488 --- ParallelTerminationStrategy: PID 26447 died... 01:54:37.297880 run osmo-stp_10.42.42.4(pid=26447): Terminated: ok {rc=0} 01:54:37.344570 --- ParallelTerminationStrategy: PID 26450 died... 01:54:37.364527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26450): Terminated: ok {rc=0} 01:54:37.410948 --- ParallelTerminationStrategy: PID 26453 died... 01:54:37.430855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26453): Terminated: ok {rc=0} ---------------------------------------------- trial-2397 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 01:54:37.482661 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:37.494676 tst smpp: Using 1 x bts (candidates: 1) 01:54:37.531657 tst esme_ms_sms_storeforward.py: using LAC 37735 01:54:37.664277 tst esme_ms_sms_storeforward.py: using RAC 250 01:54:37.797581 tst esme_ms_sms_storeforward.py: using CellId 37735 01:54:37.926669 tst esme_ms_sms_storeforward.py: using BVCI 37736 01:54:38.046761 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:38.057849 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:38.068628 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:38.079467 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:38.091183 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:38.103121 tst smpp: Using 1 x modem (candidates: 1) 01:54:38.231353 tst esme_ms_sms_storeforward.py: using MSISDN 8446 01:54:38.353885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:54:38.865402 run create_hlr_db(pid=26457): Launched 01:54:40.050083 run create_hlr_db(pid=26457): Terminated: ok {rc=0} 01:54:40.396858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26459): Launched 01:54:40.727536 run osmo-hlr_10.42.42.2(pid=26460): Launched 01:54:40.855267 run osmo-stp_10.42.42.5: Starting osmo-stp 01:54:41.428088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26462): Launched 01:54:41.760851 run osmo-stp_10.42.42.5(pid=26463): Launched 01:54:41.887563 run osmo-msc_10.42.42.6: Starting osmo-msc 01:54:42.482969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26465): Launched 01:54:42.812069 run osmo-msc_10.42.42.6(pid=26466): Launched 01:54:42.997501 run osmo-stp_10.42.42.5(pid=26463): ERR: Terminated: ERROR {rc=1} [trial-2397↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26463)] 01:54:43.136282 run osmo-stp_10.42.42.5(pid=26463): stdout: | (launched: 2022-12-14_01:54:41.699996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:43.275667 run osmo-stp_10.42.42.5(pid=26463): stderr: | [0;m[38;5;43m20221214015441893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015441893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015441893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015441894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015441894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015441894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015441894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:43.412921 run osmo-stp_10.42.42.5(pid=26463): stdout: | (launched: 2022-12-14_01:54:41.699996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:43.543955 run osmo-stp_10.42.42.5(pid=26463): stderr: | [0;m[38;5;43m20221214015441893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015441893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015441893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015441894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015441894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015441894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015441894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:43.700700 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=26463): Process ended prematurely: osmo-stp_10.42.42.5(pid=26463) [trial-2397↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26463)] [trial-2397↪smpp↪esme_ms_sms_storeforward.py:30] 01:54:43.709826 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.2 sec) 01:54:43.736998 run osmo-hlr_10.42.42.2(pid=26460): ERR: Terminated: ERROR {rc=237} [trial-2397↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26460)] 01:54:43.787517 run osmo-hlr_10.42.42.2(pid=26460): stdout: | (launched: 2022-12-14_01:54:40.666910) 01:54:43.839412 run osmo-hlr_10.42.42.2(pid=26460): stderr: | [0;m[1;31m20221214015440867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015440867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015440867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015440867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015440867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015440867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015440879 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015440888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015440888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015440888 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:43.911927 run osmo-msc_10.42.42.6(pid=26466): ERR: Terminated: ERROR {rc=2} [trial-2397↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26466)] 01:54:43.961502 run osmo-msc_10.42.42.6(pid=26466): stdout: | (launched: 2022-12-14_01:54:42.751651) 01:54:44.013493 run osmo-msc_10.42.42.6(pid=26466): stderr: | [0;m[38;5;43m20221214015443072 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214015443072 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5ab4b6ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214015443072 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214015443072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214015443072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214015443072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214015443074 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214015443075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214015443075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214015443075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:54:44.065331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26459): Terminating (SIGTERM) 01:54:44.107448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26462): Terminating (SIGTERM) 01:54:44.149473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26465): Terminating (SIGTERM) 01:54:44.191467 --- ParallelTerminationStrategy: PID 26459 died... 01:54:44.211675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26459): Terminated: ok {rc=0} 01:54:44.257691 --- ParallelTerminationStrategy: PID 26462 died... 01:54:44.277358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26462): Terminated: ok {rc=0} 01:54:44.323115 --- ParallelTerminationStrategy: PID 26465 died... 01:54:44.342879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26465): Terminated: ok {rc=0} 01:54:44.430705 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 smpp esme_ms_sms_transaction.py ---------------------------------------------- 01:54:45.517542 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:45.529338 tst smpp: Using 1 x bts (candidates: 1) 01:54:45.566669 tst esme_ms_sms_transaction.py: using LAC 37736 01:54:45.690332 tst esme_ms_sms_transaction.py: using RAC 251 01:54:45.813288 tst esme_ms_sms_transaction.py: using CellId 37736 01:54:45.968241 tst esme_ms_sms_transaction.py: using BVCI 37737 01:54:46.109906 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:46.121931 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:46.134127 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:46.146127 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:46.158802 tst smpp: Using 1 x ip_address (candidates: 6) 01:54:46.171258 tst smpp: Using 1 x modem (candidates: 1) 01:54:46.316226 tst esme_ms_sms_transaction.py: using MSISDN 8447 01:54:46.431557 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:54:46.922125 run create_hlr_db(pid=26468): Launched 01:54:47.085314 bus /sierra_2: Setting Powered False 01:54:48.150139 run create_hlr_db(pid=26468): Terminated: ok {rc=0} 01:54:48.591841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26470): Launched 01:54:48.902205 run osmo-hlr_10.42.42.2(pid=26471): Launched 01:54:49.018708 run osmo-stp_10.42.42.5: Starting osmo-stp 01:54:49.543465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26473): Launched 01:54:49.850693 run osmo-stp_10.42.42.5(pid=26474): Launched 01:54:49.968835 run osmo-msc_10.42.42.6: Starting osmo-msc 01:54:50.520880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26476): Launched 01:54:50.825746 run osmo-msc_10.42.42.6(pid=26477): Launched 01:54:50.996775 run osmo-stp_10.42.42.5(pid=26474): ERR: Terminated: ERROR {rc=1} [trial-2397↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26474)] 01:54:51.125619 run osmo-stp_10.42.42.5(pid=26474): stdout: | (launched: 2022-12-14_01:54:49.793579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:51.254649 run osmo-stp_10.42.42.5(pid=26474): stderr: | [0;m[38;5;43m20221214015449965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015449965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015449965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015449965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015449966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015449966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015449966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:51.381478 run osmo-stp_10.42.42.5(pid=26474): stdout: | (launched: 2022-12-14_01:54:49.793579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:54:51.502717 run osmo-stp_10.42.42.5(pid=26474): stderr: | [0;m[38;5;43m20221214015449965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015449965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015449965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015449965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015449966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015449966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015449966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:54:51.648064 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=26474): Process ended prematurely: osmo-stp_10.42.42.5(pid=26474) [trial-2397↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26474)] [trial-2397↪smpp↪esme_ms_sms_transaction.py:28] 01:54:51.656316 tst esme_ms_sms_transaction.py:28: Test FAILED (6.1 sec) 01:54:51.682006 run osmo-hlr_10.42.42.2(pid=26471): ERR: Terminated: ERROR {rc=237} [trial-2397↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26471)] 01:54:51.729156 run osmo-hlr_10.42.42.2(pid=26471): stdout: | (launched: 2022-12-14_01:54:48.845183) 01:54:51.778040 run osmo-hlr_10.42.42.2(pid=26471): stderr: | [0;m[1;31m20221214015449021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015449021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015449021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015449021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015449021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015449021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015449048 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015449057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015449057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015449058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:54:51.846559 run osmo-msc_10.42.42.6(pid=26477): ERR: Terminated: ERROR {rc=2} [trial-2397↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26477)] 01:54:51.893663 run osmo-msc_10.42.42.6(pid=26477): stdout: | (launched: 2022-12-14_01:54:50.768577) 01:54:51.942591 run osmo-msc_10.42.42.6(pid=26477): stderr: | [0;m[38;5;43m20221214015451040 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214015451041 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd33f547c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214015451041 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214015451041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214015451041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214015451041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214015451043 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214015451043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214015451044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214015451044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:54:51.991781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26470): Terminating (SIGTERM) 01:54:52.031744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26473): Terminating (SIGTERM) 01:54:52.071818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26476): Terminating (SIGTERM) 01:54:52.111905 --- ParallelTerminationStrategy: PID 26470 died... 01:54:52.130951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26470): Terminated: ok {rc=0} 01:54:52.174830 --- ParallelTerminationStrategy: PID 26473 died... 01:54:52.193359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26473): Terminated: ok {rc=0} 01:54:52.236891 --- ParallelTerminationStrategy: PID 26476 died... 01:54:52.255851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26476): Terminated: ok {rc=0} 01:54:52.341809 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 encryption --------------------------------------------------------------------- 01:54:53.533813 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:54:53.536473 tst encryption: Verifying 1 x bts (candidates: 11) 01:54:53.557176 tst encryption: Verifying 6 x ip_address (candidates: 9) 01:54:53.583540 tst encryption: Verifying 1 x modem (candidates: 12) 01:54:53.618422 tst encryption: Reserving 1 x bts (candidates: 11) 01:54:53.639159 tst encryption: Reserving 6 x ip_address (candidates: 9) 01:54:53.665524 tst encryption: Reserving 1 x modem (candidates: 12) 01:54:54.193987 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2397 encryption register_a5_0_authopt.py ---------------------------------------------- 01:54:54.244920 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:54.255579 tst encryption: Using 1 x bts (candidates: 1) 01:54:54.291016 tst register_a5_0_authopt.py: using LAC 37737 01:54:54.415776 tst register_a5_0_authopt.py: using RAC 252 01:54:54.538300 tst register_a5_0_authopt.py: using CellId 37737 01:54:54.660661 tst register_a5_0_authopt.py: using BVCI 37738 01:54:54.772540 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:54.783030 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:54.793489 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:54.803759 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:54.814087 tst encryption: Using 1 x ip_address (candidates: 6) 01:54:54.824277 tst encryption: Using 1 x modem (candidates: 1) 01:54:54.944611 tst register_a5_0_authopt.py:8: start network... 01:54:55.170425 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:54:55.685193 run create_hlr_db(pid=26483): Launched 01:54:55.814428 bus /sierra_2: Setting Powered False 01:54:56.880471 run create_hlr_db(pid=26483): Terminated: ok {rc=0} 01:54:57.343284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26485): Launched 01:54:57.675569 run osmo-hlr_10.42.42.2(pid=26486): Launched 01:54:57.803813 run osmo-stp_10.42.42.5: Starting osmo-stp 01:54:58.377847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26488): Launched 01:54:58.713288 run osmo-stp_10.42.42.5(pid=26489): Launched 01:54:58.839564 run osmo-msc_10.42.42.6: Starting osmo-msc 01:54:59.438240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26491): Launched 01:54:59.770227 run osmo-msc_10.42.42.6(pid=26492): Launched 01:54:59.955026 run osmo-stp_10.42.42.5(pid=26489): ERR: Terminated: ERROR {rc=1} [trial-2397↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26489)] 01:55:00.094237 run osmo-stp_10.42.42.5(pid=26489): stdout: | (launched: 2022-12-14_01:54:58.651431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:55:00.235044 run osmo-stp_10.42.42.5(pid=26489): stderr: | [0;m[38;5;43m20221214015458847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015458847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015458848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015458848 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015458849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015458849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015458849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:55:00.374207 run osmo-stp_10.42.42.5(pid=26489): stdout: | (launched: 2022-12-14_01:54:58.651431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:55:00.506322 run osmo-stp_10.42.42.5(pid=26489): stderr: | [0;m[38;5;43m20221214015458847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015458847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015458848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015458848 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015458849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015458849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015458849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:55:00.664298 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26489): Process ended prematurely: osmo-stp_10.42.42.5(pid=26489) [trial-2397↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26489)] [trial-2397↪encryption↪register_a5_0_authopt.py:8] 01:55:00.674006 tst register_a5_0_authopt.py:8: Test FAILED (6.5 sec) 01:55:00.701403 run osmo-hlr_10.42.42.2(pid=26486): ERR: Terminated: ERROR {rc=237} [trial-2397↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26486)] 01:55:00.751524 run osmo-hlr_10.42.42.2(pid=26486): stdout: | (launched: 2022-12-14_01:54:57.614803) 01:55:00.803325 run osmo-hlr_10.42.42.2(pid=26486): stderr: | [0;m[1;31m20221214015457813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015457813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015457813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015457813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015457813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015457813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015457835 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015457845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015457846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015457846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:55:00.902982 run osmo-msc_10.42.42.6(pid=26492): ERR: Terminated: ERROR {rc=2} [trial-2397↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26492)] 01:55:00.952663 run osmo-msc_10.42.42.6(pid=26492): stdout: | (launched: 2022-12-14_01:54:59.709079) 01:55:01.003897 run osmo-msc_10.42.42.6(pid=26492): stderr: | [0;m[38;5;43m20221214015500033 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214015500033 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f75bbd2bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214015500033 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214015500033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214015500033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214015500033 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214015500035 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214015500035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214015500035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214015500036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:55:01.055015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26485): Terminating (SIGTERM) 01:55:01.096541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26488): Terminating (SIGTERM) 01:55:01.140017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26491): Terminating (SIGTERM) 01:55:01.184012 --- ParallelTerminationStrategy: PID 26485 died... 01:55:01.206320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26485): Terminated: ok {rc=0} 01:55:01.253573 --- ParallelTerminationStrategy: PID 26488 died... 01:55:01.273919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26488): Terminated: ok {rc=0} 01:55:01.319994 --- ParallelTerminationStrategy: PID 26491 died... 01:55:01.340745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26491): Terminated: ok {rc=0} 01:55:01.432288 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 encryption register_a5_0_authreq.py ---------------------------------------------- 01:55:02.588245 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:02.599709 tst encryption: Using 1 x bts (candidates: 1) 01:55:02.636860 tst register_a5_0_authreq.py: using LAC 37738 01:55:02.769942 tst register_a5_0_authreq.py: using RAC 253 01:55:02.891899 tst register_a5_0_authreq.py: using CellId 37738 01:55:03.013216 tst register_a5_0_authreq.py: using BVCI 37739 01:55:03.135171 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:03.146208 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:03.157406 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:03.168124 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:03.179206 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:03.190437 tst encryption: Using 1 x modem (candidates: 1) 01:55:03.310459 tst register_a5_0_authreq.py:8: start network... 01:55:03.519329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:55:04.000757 run create_hlr_db(pid=26497): Launched 01:55:04.129469 bus /sierra_2: Setting Powered False 01:55:05.190152 run create_hlr_db(pid=26497): Terminated: ok {rc=0} 01:55:05.643088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26499): Launched 01:55:05.977782 run osmo-hlr_10.42.42.2(pid=26500): Launched 01:55:06.104399 run osmo-stp_10.42.42.5: Starting osmo-stp 01:55:06.680608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26502): Launched 01:55:07.013529 run osmo-stp_10.42.42.5(pid=26503): Launched 01:55:07.141860 run osmo-msc_10.42.42.6: Starting osmo-msc 01:55:07.744320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26505): Launched 01:55:08.079345 run osmo-msc_10.42.42.6(pid=26506): Launched 01:55:08.267466 run osmo-stp_10.42.42.5(pid=26503): ERR: Terminated: ERROR {rc=1} [trial-2397↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26503)] 01:55:08.407153 run osmo-stp_10.42.42.5(pid=26503): stdout: | (launched: 2022-12-14_01:55:06.952118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:55:08.547886 run osmo-stp_10.42.42.5(pid=26503): stderr: | [0;m[38;5;43m20221214015507146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015507146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015507146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015507146 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015507147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015507147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015507147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:55:08.686697 run osmo-stp_10.42.42.5(pid=26503): stdout: | (launched: 2022-12-14_01:55:06.952118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:55:08.818691 run osmo-stp_10.42.42.5(pid=26503): stderr: | [0;m[38;5;43m20221214015507146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015507146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015507146 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015507146 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015507147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015507147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015507147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:55:08.976770 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26503): Process ended prematurely: osmo-stp_10.42.42.5(pid=26503) [trial-2397↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26503)] [trial-2397↪encryption↪register_a5_0_authreq.py:8] 01:55:08.986512 tst register_a5_0_authreq.py:8: Test FAILED (6.4 sec) 01:55:09.014089 run osmo-hlr_10.42.42.2(pid=26500): ERR: Terminated: ERROR {rc=237} [trial-2397↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26500)] 01:55:09.064297 run osmo-hlr_10.42.42.2(pid=26500): stdout: | (launched: 2022-12-14_01:55:05.916297) 01:55:09.116484 run osmo-hlr_10.42.42.2(pid=26500): stderr: | [0;m[1;31m20221214015506116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015506116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015506116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015506116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015506116 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015506117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015506129 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015506137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015506137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015506137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:55:09.188493 run osmo-msc_10.42.42.6(pid=26506): ERR: Terminated: ERROR {rc=2} [trial-2397↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26506)] 01:55:09.237925 run osmo-msc_10.42.42.6(pid=26506): stdout: | (launched: 2022-12-14_01:55:08.017995) 01:55:09.289411 run osmo-msc_10.42.42.6(pid=26506): stderr: | [0;m[38;5;43m20221214015508340 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214015508341 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5b9c740c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214015508341 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214015508341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214015508341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214015508341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214015508343 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214015508344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214015508344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214015508344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:55:09.341072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26499): Terminating (SIGTERM) 01:55:09.382763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26502): Terminating (SIGTERM) 01:55:09.425132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26505): Terminating (SIGTERM) 01:55:09.466994 --- ParallelTerminationStrategy: PID 26499 died... 01:55:09.487265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26499): Terminated: ok {rc=0} 01:55:09.533305 --- ParallelTerminationStrategy: PID 26502 died... 01:55:09.552886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26502): Terminated: ok {rc=0} 01:55:09.598797 --- ParallelTerminationStrategy: PID 26505 died... 01:55:09.618542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26505): Terminated: ok {rc=0} 01:55:09.706643 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 encryption register_a5_1_authreq.py ---------------------------------------------- 01:55:10.858446 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:10.870249 tst encryption: Using 1 x bts (candidates: 1) 01:55:10.908054 tst register_a5_1_authreq.py: using LAC 37739 01:55:11.042563 tst register_a5_1_authreq.py: using RAC 254 01:55:11.166293 tst register_a5_1_authreq.py: using CellId 37739 01:55:11.290242 tst register_a5_1_authreq.py: using BVCI 37740 01:55:11.403595 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:11.414254 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:11.424719 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:11.435098 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:11.445464 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:11.455773 tst encryption: Using 1 x modem (candidates: 1) 01:55:11.576482 tst register_a5_1_authreq.py:8: start network... 01:55:11.802487 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:55:12.318931 run create_hlr_db(pid=26508): Launched 01:55:12.447651 bus /sierra_2: Setting Powered False 01:55:13.512747 run create_hlr_db(pid=26508): Terminated: ok {rc=0} 01:55:13.977345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26510): Launched 01:55:14.314254 run osmo-hlr_10.42.42.2(pid=26511): Launched 01:55:14.441993 run osmo-stp_10.42.42.5: Starting osmo-stp 01:55:15.017588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26513): Launched 01:55:15.354968 run osmo-stp_10.42.42.5(pid=26514): Launched 01:55:15.483753 run osmo-msc_10.42.42.6: Starting osmo-msc 01:55:16.117451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26516): Launched 01:55:16.457735 run osmo-msc_10.42.42.6(pid=26517): Launched 01:55:16.801038 run osmo-stp_10.42.42.5(pid=26514): ERR: Terminated: ERROR {rc=1} [trial-2397↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26514)] 01:55:17.165089 run osmo-stp_10.42.42.5(pid=26514): stdout: | (launched: 2022-12-14_01:55:15.292873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:55:17.425175 run osmo-stp_10.42.42.5(pid=26514): stderr: | [0;m[38;5;43m20221214015515487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015515487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015515488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015515488 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015515489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015515489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015515489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:55:17.555289 run osmo-stp_10.42.42.5(pid=26514): stdout: | (launched: 2022-12-14_01:55:15.292873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:55:17.679361 run osmo-stp_10.42.42.5(pid=26514): stderr: | [0;m[38;5;43m20221214015515487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015515487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015515488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015515488 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015515489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015515489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015515489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:55:17.826894 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26514): Process ended prematurely: osmo-stp_10.42.42.5(pid=26514) [trial-2397↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26514)] [trial-2397↪encryption↪register_a5_1_authreq.py:8] 01:55:17.835766 tst register_a5_1_authreq.py:8: Test FAILED (7.0 sec) 01:55:17.862022 run osmo-hlr_10.42.42.2(pid=26511): ERR: Terminated: ERROR {rc=237} [trial-2397↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26511)] 01:55:17.909268 run osmo-hlr_10.42.42.2(pid=26511): stdout: | (launched: 2022-12-14_01:55:14.252454) 01:55:17.958196 run osmo-hlr_10.42.42.2(pid=26511): stderr: | [0;m[1;31m20221214015514453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015514453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015514453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015514453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015514453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015514454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015514467 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015514475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015514476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015514476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:55:18.026863 run osmo-msc_10.42.42.6(pid=26517): ERR: Terminated: ERROR {rc=2} [trial-2397↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26517)] 01:55:18.074085 run osmo-msc_10.42.42.6(pid=26517): stdout: | (launched: 2022-12-14_01:55:16.395044) 01:55:18.123100 run osmo-msc_10.42.42.6(pid=26517): stderr: | [0;m[38;5;43m20221214015517036 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214015517036 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fae465b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214015517036 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214015517036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214015517036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214015517037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214015517038 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214015517039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214015517039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214015517039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:55:18.172401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26510): Terminating (SIGTERM) 01:55:18.211760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26513): Terminating (SIGTERM) 01:55:18.251355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26516): Terminating (SIGTERM) 01:55:18.291045 --- ParallelTerminationStrategy: PID 26510 died... 01:55:18.309597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26510): Terminated: ok {rc=0} 01:55:18.353325 --- ParallelTerminationStrategy: PID 26513 died... 01:55:18.371920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26513): Terminated: ok {rc=0} 01:55:18.415504 --- ParallelTerminationStrategy: PID 26516 died... 01:55:18.434052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26516): Terminated: ok {rc=0} 01:55:18.519696 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2397 encryption register_a5_3_authreq.py ---------------------------------------------- 01:55:19.670730 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:19.682030 tst encryption: Using 1 x bts (candidates: 1) 01:55:19.718563 tst register_a5_3_authreq.py: using LAC 37740 01:55:19.849961 tst register_a5_3_authreq.py: using RAC 255 01:55:19.980539 tst register_a5_3_authreq.py: using CellId 37740 01:55:20.112186 tst register_a5_3_authreq.py: using BVCI 37741 01:55:20.233408 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:20.244439 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:20.255431 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:20.266380 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:20.277615 tst encryption: Using 1 x ip_address (candidates: 6) 01:55:20.288670 tst encryption: Using 1 x modem (candidates: 1) 01:55:20.421168 tst register_a5_3_authreq.py:8: start network... 01:55:20.647298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:55:21.160693 run create_hlr_db(pid=26519): Launched 01:55:21.289350 bus /sierra_2: Setting Powered False 01:55:22.354977 run create_hlr_db(pid=26519): Terminated: ok {rc=0} 01:55:22.815836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26521): Launched 01:55:23.151376 run osmo-hlr_10.42.42.2(pid=26522): Launched 01:55:23.280735 run osmo-stp_10.42.42.5: Starting osmo-stp 01:55:23.851772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26524): Launched 01:55:24.185408 run osmo-stp_10.42.42.5(pid=26525): Launched 01:55:24.313649 run osmo-msc_10.42.42.6: Starting osmo-msc 01:55:24.915630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26527): Launched 01:55:25.249473 run osmo-msc_10.42.42.6(pid=26528): Launched 01:55:25.436141 run osmo-stp_10.42.42.5(pid=26525): ERR: Terminated: ERROR {rc=1} [trial-2397↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26525)] 01:55:25.575804 run osmo-stp_10.42.42.5(pid=26525): stdout: | (launched: 2022-12-14_01:55:24.123947) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:55:25.716317 run osmo-stp_10.42.42.5(pid=26525): stderr: | [0;m[38;5;43m20221214015524319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015524319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015524319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015524320 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015524320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015524320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015524320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:55:25.855082 run osmo-stp_10.42.42.5(pid=26525): stdout: | (launched: 2022-12-14_01:55:24.123947) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:55:25.987360 run osmo-stp_10.42.42.5(pid=26525): stderr: | [0;m[38;5;43m20221214015524319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015524319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015524319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015524320 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015524320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015524320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015524320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:55:26.146453 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26525): Process ended prematurely: osmo-stp_10.42.42.5(pid=26525) [trial-2397↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26525)] [trial-2397↪encryption↪register_a5_3_authreq.py:8] 01:55:26.156150 tst register_a5_3_authreq.py:8: Test FAILED (6.5 sec) 01:55:26.183730 run osmo-hlr_10.42.42.2(pid=26522): ERR: Terminated: ERROR {rc=237} [trial-2397↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26522)] 01:55:26.234280 run osmo-hlr_10.42.42.2(pid=26522): stdout: | (launched: 2022-12-14_01:55:23.089891) 01:55:26.286623 run osmo-hlr_10.42.42.2(pid=26522): stderr: | [0;m[1;31m20221214015523291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015523291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015523291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015523291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015523291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015523291 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015523302 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015523311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015523311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015523311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:55:26.358536 run osmo-msc_10.42.42.6(pid=26528): ERR: Terminated: ERROR {rc=2} [trial-2397↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26528)] 01:55:26.408018 run osmo-msc_10.42.42.6(pid=26528): stdout: | (launched: 2022-12-14_01:55:25.188082) 01:55:26.459651 run osmo-msc_10.42.42.6(pid=26528): stderr: | [0;m[38;5;43m20221214015525510 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214015525510 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f085946fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214015525510 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214015525510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214015525510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214015525510 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214015525512 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214015525512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214015525512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214015525513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:55:26.511935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26521): Terminating (SIGTERM) 01:55:26.553597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26524): Terminating (SIGTERM) 01:55:26.595457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26527): Terminating (SIGTERM) 01:55:26.637477 --- ParallelTerminationStrategy: PID 26521 died... 01:55:26.657688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26521): Terminated: ok {rc=0} 01:55:26.703967 --- ParallelTerminationStrategy: PID 26524 died... 01:55:26.723507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26524): Terminated: ok {rc=0} 01:55:26.769514 --- ParallelTerminationStrategy: PID 26527 died... 01:55:26.789301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26527): Terminated: ok {rc=0} 01:55:26.877499 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 01:55:28.086825 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:55:28.092178 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 01:55:28.110865 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 01:55:28.139557 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 01:55:28.170608 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 01:55:28.189397 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 01:55:28.215790 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 01:55:28.727157 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2397 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 01:55:28.733090 tst handover.py:11: TEST_CONFIG: {} 01:55:28.955755 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:55:28.972095 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:55:28.995791 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:55:29.046743 tst handover.py: using MSISDN 8448 01:55:29.169731 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8448', subscriber_id=0} 01:55:29.287154 run srsepc_10.42.42.118: Starting srsepc 01:55:31.261198 run rm-remote-dir(pid=26533): Launched 01:55:31.412748 bus /sierra_2: Setting Powered False 01:55:32.482351 run rm-remote-dir(pid=26533): Terminated: ok {rc=0} 01:55:33.004589 run mk-remote-dir(pid=26534): Launched 01:55:34.189942 run mk-remote-dir(pid=26534): Terminated: ok {rc=0} 01:55:34.502873 run scp-inst-to-remote(pid=26535): Launched 01:55:36.694944 run scp-inst-to-remote(pid=26535): Terminated: ok {rc=0} 01:55:37.037093 run rm-remote-dir(pid=26537): Launched 01:55:38.218340 run rm-remote-dir(pid=26537): Terminated: ok {rc=0} 01:55:38.560808 run mk-remote-dir(pid=26538): Launched 01:55:39.743214 run mk-remote-dir(pid=26538): Terminated: ok {rc=0} 01:55:40.044902 run scp-cfg-to-remote(pid=26539): Launched 01:55:41.237296 run scp-cfg-to-remote(pid=26539): Terminated: ok {rc=0} 01:55:41.547180 run scp-db-to-remote(pid=26541): Launched 01:55:42.739399 run scp-db-to-remote(pid=26541): Terminated: ok {rc=0} 01:55:42.881408 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:55:43.217158 run patchelf(pid=26543): Launched 01:55:44.408848 run patchelf(pid=26543): Terminated: ok {rc=0} 01:55:44.551328 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:55:44.886928 run setcap-netadm(pid=26544): Launched 01:55:46.094474 run setcap-netadm(pid=26544): Terminated: ok {rc=0} 01:55:46.489677 run srsepc(pid=26545): Launched 01:55:46.658794 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:55:47.832145 run rm-remote-dir(pid=26546): Launched 01:55:48.010864 run srsepc(pid=26545): ERR: Terminated: ERROR {rc=127} [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26545)] 01:55:48.147221 run srsepc(pid=26545): stdout: | (launched: 2022-12-14_01:55:46.422154) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:55:48.283483 run srsepc(pid=26545): stderr: | (launched: 2022-12-14_01:55:46.469162) | Connection to 10.42.42.116 closed. 01:55:48.419797 run srsepc(pid=26545): stdout: | (launched: 2022-12-14_01:55:46.422154) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:55:48.551031 run srsepc(pid=26545): stderr: | (launched: 2022-12-14_01:55:46.469162) | Connection to 10.42.42.116 closed. 01:55:48.706230 run rm-remote-dir(pid=26546): Terminating (SIGINT) 01:55:48.887180 run rm-remote-dir(pid=26546): Terminated: ok {rc=0} 01:55:49.017576 tst handover.py:37: ERR: Error: srsepc(pid=26545): Process ended prematurely: srsepc(pid=26545) [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26545)] [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 01:55:49.027651 tst handover.py:37: Test FAILED (20.3 sec) 01:55:49.106573 run scp-back-log(pid=26547): Launched 01:55:50.183940 run scp-back-log(pid=26547): ERR: Terminated: ERROR {rc=1} [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26547)] 01:55:50.245089 run scp-back-log(pid=26547): stdout: | (launched: 2022-12-14_01:55:49.075080) 01:55:50.307634 run scp-back-log(pid=26547): stderr: | (launched: 2022-12-14_01:55:49.094744) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:55:50.378227 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26547): launch_sync(): local process exited with status 1 [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26547)]') ---------------------------------------------- trial-2397 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 01:55:50.423613 tst iperf3_bidir.py:13: Number of physical ue: 1 01:55:50.632067 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:55:50.675096 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 01:55:50.883897 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:55:50.899985 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:55:50.932867 tst iperf3_bidir.py: using MSISDN 8449 01:55:51.044774 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8449', subscriber_id=0} 01:55:51.152791 run srsepc_10.42.42.118: Starting srsepc 01:55:51.788450 run rm-remote-dir(pid=26549): Launched 01:55:52.969333 run rm-remote-dir(pid=26549): Terminated: ok {rc=0} 01:55:53.310269 run mk-remote-dir(pid=26551): Launched 01:55:54.490090 run mk-remote-dir(pid=26551): Terminated: ok {rc=0} 01:55:54.780291 run scp-inst-to-remote(pid=26552): Launched 01:55:56.965361 run scp-inst-to-remote(pid=26552): Terminated: ok {rc=0} 01:55:57.327264 run rm-remote-dir(pid=26554): Launched 01:55:58.508872 run rm-remote-dir(pid=26554): Terminated: ok {rc=0} 01:55:58.849555 run mk-remote-dir(pid=26555): Launched 01:56:00.031311 run mk-remote-dir(pid=26555): Terminated: ok {rc=0} 01:56:00.321665 run scp-cfg-to-remote(pid=26556): Launched 01:56:01.501905 run scp-cfg-to-remote(pid=26556): Terminated: ok {rc=0} 01:56:01.796639 run scp-db-to-remote(pid=26558): Launched 01:56:03.055750 run scp-db-to-remote(pid=26558): Terminated: ok {rc=0} 01:56:03.197838 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:56:03.531691 run patchelf(pid=26560): Launched 01:56:04.725187 run patchelf(pid=26560): Terminated: ok {rc=0} 01:56:04.866512 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:56:05.200349 run setcap-netadm(pid=26561): Launched 01:56:06.387277 run setcap-netadm(pid=26561): Terminated: ok {rc=0} 01:56:06.714512 run srsepc(pid=26562): Launched 01:56:06.829263 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:56:08.028518 run rm-remote-dir(pid=26563): Launched 01:56:08.222020 run srsepc(pid=26562): ERR: Terminated: ERROR {rc=127} [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26562)] 01:56:08.367413 run srsepc(pid=26562): stdout: | (launched: 2022-12-14_01:56:06.656722) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:56:08.512084 run srsepc(pid=26562): stderr: | (launched: 2022-12-14_01:56:06.702804) | Connection to 10.42.42.116 closed. 01:56:08.656630 run srsepc(pid=26562): stdout: | (launched: 2022-12-14_01:56:06.656722) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:56:08.795606 run srsepc(pid=26562): stderr: | (launched: 2022-12-14_01:56:06.702804) | Connection to 10.42.42.116 closed. 01:56:08.960665 run rm-remote-dir(pid=26563): Terminating (SIGINT) 01:56:09.151799 run rm-remote-dir(pid=26563): Terminated: ok {rc=0} 01:56:09.289943 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=26562): Process ended prematurely: srsepc(pid=26562) [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26562)] [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 01:56:09.300620 tst iperf3_bidir.py:42: Test FAILED (18.9 sec) 01:56:09.381785 run scp-back-log(pid=26564): Launched 01:56:10.463541 run scp-back-log(pid=26564): ERR: Terminated: ERROR {rc=1} [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26564)] 01:56:10.526781 run scp-back-log(pid=26564): stdout: | (launched: 2022-12-14_01:56:09.349182) 01:56:10.591776 run scp-back-log(pid=26564): stderr: | (launched: 2022-12-14_01:56:09.369759) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:56:10.664626 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26564): launch_sync(): local process exited with status 1 [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26564)]') ---------------------------------------------- trial-2397 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 01:56:10.711863 tst iperf3_dl.py:13: Number of physical ue: 1 01:56:10.935488 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:56:10.981132 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 01:56:11.203827 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:56:11.220104 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:56:11.253076 tst iperf3_dl.py: using MSISDN 8450 01:56:11.372907 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8450', subscriber_id=0} 01:56:11.488898 run srsepc_10.42.42.118: Starting srsepc 01:56:12.169369 run rm-remote-dir(pid=26566): Launched 01:56:13.362821 run rm-remote-dir(pid=26566): Terminated: ok {rc=0} 01:56:13.725476 run mk-remote-dir(pid=26567): Launched 01:56:14.920234 run mk-remote-dir(pid=26567): Terminated: ok {rc=0} 01:56:15.231197 run scp-inst-to-remote(pid=26568): Launched 01:56:17.422114 run scp-inst-to-remote(pid=26568): Terminated: ok {rc=0} 01:56:17.788421 run rm-remote-dir(pid=26570): Launched 01:56:18.984880 run rm-remote-dir(pid=26570): Terminated: ok {rc=0} 01:56:19.348930 run mk-remote-dir(pid=26571): Launched 01:56:20.543149 run mk-remote-dir(pid=26571): Terminated: ok {rc=0} 01:56:20.852649 run scp-cfg-to-remote(pid=26572): Launched 01:56:22.042936 run scp-cfg-to-remote(pid=26572): Terminated: ok {rc=0} 01:56:22.351393 run scp-db-to-remote(pid=26574): Launched 01:56:23.544577 run scp-db-to-remote(pid=26574): Terminated: ok {rc=0} 01:56:23.686013 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:56:24.019864 run patchelf(pid=26576): Launched 01:56:25.213313 run patchelf(pid=26576): Terminated: ok {rc=0} 01:56:25.355428 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:56:25.690907 run setcap-netadm(pid=26577): Launched 01:56:26.882683 run setcap-netadm(pid=26577): Terminated: ok {rc=0} 01:56:27.233491 run srsepc(pid=26578): Launched 01:56:27.358663 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:56:28.488103 run rm-remote-dir(pid=26579): Launched 01:56:28.666169 run srsepc(pid=26578): ERR: Terminated: ERROR {rc=127} [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26578)] 01:56:28.801756 run srsepc(pid=26578): stdout: | (launched: 2022-12-14_01:56:27.171800) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:56:28.938200 run srsepc(pid=26578): stderr: | (launched: 2022-12-14_01:56:27.221349) | Connection to 10.42.42.116 closed. 01:56:29.074174 run srsepc(pid=26578): stdout: | (launched: 2022-12-14_01:56:27.171800) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:56:29.205879 run srsepc(pid=26578): stderr: | (launched: 2022-12-14_01:56:27.221349) | Connection to 10.42.42.116 closed. 01:56:29.360639 run rm-remote-dir(pid=26579): Terminating (SIGINT) 01:56:29.539491 run rm-remote-dir(pid=26579): Terminated: ok {rc=0} 01:56:29.668847 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=26578): Process ended prematurely: srsepc(pid=26578) [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26578)] [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 01:56:29.678888 tst iperf3_dl.py:42: Test FAILED (19.0 sec) 01:56:29.756892 run scp-back-log(pid=26580): Launched 01:56:30.842902 run scp-back-log(pid=26580): ERR: Terminated: ERROR {rc=1} [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26580)] 01:56:30.928673 run scp-back-log(pid=26580): stdout: | (launched: 2022-12-14_01:56:29.725555) 01:56:31.005672 run scp-back-log(pid=26580): stderr: | (launched: 2022-12-14_01:56:29.745202) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:56:31.082087 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26580): launch_sync(): local process exited with status 1 [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26580)]') ---------------------------------------------- trial-2397 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 01:56:31.131408 tst iperf3_ul.py:13: Number of physical ue: 1 01:56:31.362478 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:56:31.405422 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 01:56:31.638640 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:56:31.656278 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:56:31.690252 tst iperf3_ul.py: using MSISDN 8451 01:56:31.805641 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8451', subscriber_id=0} 01:56:31.916933 run srsepc_10.42.42.118: Starting srsepc 01:56:32.557059 run rm-remote-dir(pid=26582): Launched 01:56:33.738005 run rm-remote-dir(pid=26582): Terminated: ok {rc=0} 01:56:34.079036 run mk-remote-dir(pid=26583): Launched 01:56:35.262870 run mk-remote-dir(pid=26583): Terminated: ok {rc=0} 01:56:35.572776 run scp-inst-to-remote(pid=26584): Launched 01:56:37.762500 run scp-inst-to-remote(pid=26584): Terminated: ok {rc=0} 01:56:38.100724 run rm-remote-dir(pid=26586): Launched 01:56:39.280396 run rm-remote-dir(pid=26586): Terminated: ok {rc=0} 01:56:39.621607 run mk-remote-dir(pid=26587): Launched 01:56:40.801468 run mk-remote-dir(pid=26587): Terminated: ok {rc=0} 01:56:41.092136 run scp-cfg-to-remote(pid=26588): Launched 01:56:42.270281 run scp-cfg-to-remote(pid=26588): Terminated: ok {rc=0} 01:56:42.558943 run scp-db-to-remote(pid=26590): Launched 01:56:43.738155 run scp-db-to-remote(pid=26590): Terminated: ok {rc=0} 01:56:43.871335 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:56:44.183672 run patchelf(pid=26592): Launched 01:56:45.363795 run patchelf(pid=26592): Terminated: ok {rc=0} 01:56:45.497604 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:56:45.810769 run setcap-netadm(pid=26593): Launched 01:56:47.007462 run setcap-netadm(pid=26593): Terminated: ok {rc=0} 01:56:47.363328 run srsepc(pid=26594): Launched 01:56:47.489798 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:56:48.688140 run rm-remote-dir(pid=26595): Launched 01:56:48.880405 run srsepc(pid=26594): ERR: Terminated: ERROR {rc=127} [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26594)] 01:56:49.027113 run srsepc(pid=26594): stdout: | (launched: 2022-12-14_01:56:47.301926) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:56:49.173181 run srsepc(pid=26594): stderr: | (launched: 2022-12-14_01:56:47.351321) | Connection to 10.42.42.116 closed. 01:56:49.318948 run srsepc(pid=26594): stdout: | (launched: 2022-12-14_01:56:47.301926) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:56:49.459565 run srsepc(pid=26594): stderr: | (launched: 2022-12-14_01:56:47.351321) | Connection to 10.42.42.116 closed. 01:56:49.625962 run rm-remote-dir(pid=26595): Terminating (SIGINT) 01:56:49.818026 run rm-remote-dir(pid=26595): Terminated: ok {rc=0} 01:56:49.956735 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=26594): Process ended prematurely: srsepc(pid=26594) [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26594)] [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 01:56:49.967408 tst iperf3_ul.py:42: Test FAILED (18.8 sec) 01:56:50.048783 run scp-back-log(pid=26596): Launched 01:56:51.132024 run scp-back-log(pid=26596): ERR: Terminated: ERROR {rc=1} [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26596)] 01:56:51.195852 run scp-back-log(pid=26596): stdout: | (launched: 2022-12-14_01:56:50.016065) 01:56:51.260766 run scp-back-log(pid=26596): stderr: | (launched: 2022-12-14_01:56:50.036786) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:56:51.333731 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26596): launch_sync(): local process exited with status 1 [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26596)]') ---------------------------------------------- trial-2397 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 01:56:51.381327 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:56:51.398677 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:56:51.422186 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:56:51.472133 tst ping.py: using MSISDN 8452 01:56:51.595698 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8452', subscriber_id=0} 01:56:51.711855 run srsepc_10.42.42.118: Starting srsepc 01:56:52.396042 run rm-remote-dir(pid=26598): Launched 01:56:53.589914 run rm-remote-dir(pid=26598): Terminated: ok {rc=0} 01:56:53.953129 run mk-remote-dir(pid=26599): Launched 01:56:55.147828 run mk-remote-dir(pid=26599): Terminated: ok {rc=0} 01:56:55.458652 run scp-inst-to-remote(pid=26600): Launched 01:56:57.647807 run scp-inst-to-remote(pid=26600): Terminated: ok {rc=0} 01:56:57.987835 run rm-remote-dir(pid=26602): Launched 01:56:59.167973 run rm-remote-dir(pid=26602): Terminated: ok {rc=0} 01:56:59.509517 run mk-remote-dir(pid=26603): Launched 01:57:00.691407 run mk-remote-dir(pid=26603): Terminated: ok {rc=0} 01:57:01.009606 run scp-cfg-to-remote(pid=26604): Launched 01:57:02.259014 run scp-cfg-to-remote(pid=26604): Terminated: ok {rc=0} 01:57:02.570460 run scp-db-to-remote(pid=26606): Launched 01:57:03.763131 run scp-db-to-remote(pid=26606): Terminated: ok {rc=0} 01:57:03.904728 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:57:04.238942 run patchelf(pid=26608): Launched 01:57:05.430165 run patchelf(pid=26608): Terminated: ok {rc=0} 01:57:05.572211 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:57:05.905878 run setcap-netadm(pid=26609): Launched 01:57:07.099083 run setcap-netadm(pid=26609): Terminated: ok {rc=0} 01:57:07.449516 run srsepc(pid=26610): Launched 01:57:07.574583 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:57:08.773660 run rm-remote-dir(pid=26611): Launched 01:57:08.968467 run srsepc(pid=26610): ERR: Terminated: ERROR {rc=127} [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26610)] 01:57:09.115376 run srsepc(pid=26610): stdout: | (launched: 2022-12-14_01:57:07.387723) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:57:09.261792 run srsepc(pid=26610): stderr: | (launched: 2022-12-14_01:57:07.437303) | Connection to 10.42.42.116 closed. 01:57:09.407146 run srsepc(pid=26610): stdout: | (launched: 2022-12-14_01:57:07.387723) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:57:09.547664 run srsepc(pid=26610): stderr: | (launched: 2022-12-14_01:57:07.437303) | Connection to 10.42.42.116 closed. 01:57:09.713473 run rm-remote-dir(pid=26611): Terminating (SIGINT) 01:57:09.905662 run rm-remote-dir(pid=26611): Terminated: ok {rc=0} 01:57:10.044565 tst ping.py:16: ERR: Error: srsepc(pid=26610): Process ended prematurely: srsepc(pid=26610) [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26610)] [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 01:57:10.055264 tst ping.py:16: Test FAILED (18.7 sec) 01:57:10.136865 run scp-back-log(pid=26612): Launched 01:57:11.218261 run scp-back-log(pid=26612): ERR: Terminated: ERROR {rc=1} [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26612)] 01:57:11.281635 run scp-back-log(pid=26612): stdout: | (launched: 2022-12-14_01:57:10.103680) 01:57:11.346395 run scp-back-log(pid=26612): stderr: | (launched: 2022-12-14_01:57:10.124178) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:57:11.419378 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26612): launch_sync(): local process exited with status 1 [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26612)]') ---------------------------------------------- trial-2397 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 01:57:11.467138 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:57:11.484353 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:57:11.508006 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:57:11.559480 tst rrc_idle_mo_ping.py: using MSISDN 8453 01:57:11.683049 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8453', subscriber_id=0} 01:57:11.798927 run srsepc_10.42.42.118: Starting srsepc 01:57:12.479234 run rm-remote-dir(pid=26614): Launched 01:57:13.673970 run rm-remote-dir(pid=26614): Terminated: ok {rc=0} 01:57:14.037472 run mk-remote-dir(pid=26615): Launched 01:57:15.231917 run mk-remote-dir(pid=26615): Terminated: ok {rc=0} 01:57:15.542028 run scp-inst-to-remote(pid=26616): Launched 01:57:17.733415 run scp-inst-to-remote(pid=26616): Terminated: ok {rc=0} 01:57:18.094666 run rm-remote-dir(pid=26618): Launched 01:57:19.287714 run rm-remote-dir(pid=26618): Terminated: ok {rc=0} 01:57:19.650855 run mk-remote-dir(pid=26619): Launched 01:57:20.842342 run mk-remote-dir(pid=26619): Terminated: ok {rc=0} 01:57:21.133189 run scp-cfg-to-remote(pid=26620): Launched 01:57:22.310795 run scp-cfg-to-remote(pid=26620): Terminated: ok {rc=0} 01:57:22.599893 run scp-db-to-remote(pid=26622): Launched 01:57:23.779078 run scp-db-to-remote(pid=26622): Terminated: ok {rc=0} 01:57:23.912112 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:57:24.224581 run patchelf(pid=26624): Launched 01:57:25.402961 run patchelf(pid=26624): Terminated: ok {rc=0} 01:57:25.536673 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:57:25.850387 run setcap-netadm(pid=26625): Launched 01:57:27.027916 run setcap-netadm(pid=26625): Terminated: ok {rc=0} 01:57:27.355065 run srsepc(pid=26626): Launched 01:57:27.471083 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:57:28.591958 run rm-remote-dir(pid=26627): Launched 01:57:28.770076 run srsepc(pid=26626): ERR: Terminated: ERROR {rc=127} [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26626)] 01:57:28.906181 run srsepc(pid=26626): stdout: | (launched: 2022-12-14_01:57:27.297520) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:57:29.042292 run srsepc(pid=26626): stderr: | (launched: 2022-12-14_01:57:27.343320) | Connection to 10.42.42.116 closed. 01:57:29.178628 run srsepc(pid=26626): stdout: | (launched: 2022-12-14_01:57:27.297520) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:57:29.309399 run srsepc(pid=26626): stderr: | (launched: 2022-12-14_01:57:27.343320) | Connection to 10.42.42.116 closed. 01:57:29.464070 run rm-remote-dir(pid=26627): Terminating (SIGINT) 01:57:29.644012 run rm-remote-dir(pid=26627): Terminated: ok {rc=0} 01:57:29.774145 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=26626): Process ended prematurely: srsepc(pid=26626) [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26626)] [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 01:57:29.784136 tst rrc_idle_mo_ping.py:16: Test FAILED (18.3 sec) 01:57:29.862712 run scp-back-log(pid=26628): Launched 01:57:30.941833 run scp-back-log(pid=26628): ERR: Terminated: ERROR {rc=1} [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26628)] 01:57:31.019135 run scp-back-log(pid=26628): stdout: | (launched: 2022-12-14_01:57:29.831200) 01:57:31.105188 run scp-back-log(pid=26628): stderr: | (launched: 2022-12-14_01:57:29.850800) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:57:31.199780 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26628): launch_sync(): local process exited with status 1 [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26628)]') ---------------------------------------------- trial-2397 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 01:57:31.250421 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 01:57:31.268306 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 01:57:31.294634 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 01:57:31.344239 tst rrc_idle_mt_ping.py: using MSISDN 8454 01:57:31.490003 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8454', subscriber_id=0} 01:57:31.600897 run srsepc_10.42.42.118: Starting srsepc 01:57:32.249239 run rm-remote-dir(pid=26630): Launched 01:57:33.431922 run rm-remote-dir(pid=26630): Terminated: ok {rc=0} 01:57:33.774740 run mk-remote-dir(pid=26631): Launched 01:57:34.955484 run mk-remote-dir(pid=26631): Terminated: ok {rc=0} 01:57:35.247046 run scp-inst-to-remote(pid=26632): Launched 01:57:37.427951 run scp-inst-to-remote(pid=26632): Terminated: ok {rc=0} 01:57:37.768071 run rm-remote-dir(pid=26634): Launched 01:57:38.948266 run rm-remote-dir(pid=26634): Terminated: ok {rc=0} 01:57:39.289396 run mk-remote-dir(pid=26635): Launched 01:57:40.470800 run mk-remote-dir(pid=26635): Terminated: ok {rc=0} 01:57:40.763167 run scp-cfg-to-remote(pid=26636): Launched 01:57:41.941904 run scp-cfg-to-remote(pid=26636): Terminated: ok {rc=0} 01:57:42.230966 run scp-db-to-remote(pid=26638): Launched 01:57:43.409915 run scp-db-to-remote(pid=26638): Terminated: ok {rc=0} 01:57:43.542760 run srsepc_10.42.42.118: Setting RPATH for srsepc 01:57:43.855883 run patchelf(pid=26640): Launched 01:57:45.039245 run patchelf(pid=26640): Terminated: ok {rc=0} 01:57:45.181972 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 01:57:45.518323 run setcap-netadm(pid=26641): Launched 01:57:46.737058 run setcap-netadm(pid=26641): Terminated: ok {rc=0} 01:57:47.075833 run srsepc(pid=26642): Launched 01:57:47.250103 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 01:57:48.373473 run rm-remote-dir(pid=26643): Launched 01:57:48.552348 run srsepc(pid=26642): ERR: Terminated: ERROR {rc=127} [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26642)] 01:57:48.689240 run srsepc(pid=26642): stdout: | (launched: 2022-12-14_01:57:47.016911) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:57:48.826884 run srsepc(pid=26642): stderr: | (launched: 2022-12-14_01:57:47.064346) | Connection to 10.42.42.116 closed. 01:57:48.964252 run srsepc(pid=26642): stdout: | (launched: 2022-12-14_01:57:47.016911) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 01:57:49.095890 run srsepc(pid=26642): stderr: | (launched: 2022-12-14_01:57:47.064346) | Connection to 10.42.42.116 closed. 01:57:49.251733 run rm-remote-dir(pid=26643): Terminating (SIGINT) 01:57:49.432613 run rm-remote-dir(pid=26643): Terminated: ok {rc=0} 01:57:49.563271 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=26642): Process ended prematurely: srsepc(pid=26642) [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26642)] [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 01:57:49.573417 tst rrc_idle_mt_ping.py:16: Test FAILED (18.3 sec) 01:57:49.651895 run scp-back-log(pid=26644): Launched 01:57:50.729232 run scp-back-log(pid=26644): ERR: Terminated: ERROR {rc=1} [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26644)] 01:57:50.790387 run scp-back-log(pid=26644): stdout: | (launched: 2022-12-14_01:57:49.620428) 01:57:50.853255 run scp-back-log(pid=26644): stderr: | (launched: 2022-12-14_01:57:49.640211) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 01:57:50.923866 tst srsepc_10.42.42.118: Error('scp-back-log(pid=26644): launch_sync(): local process exited with status 1 [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=26644)]') --------------------------------------------------------------------- trial-2397 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 01:57:51.055465 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:57:51.060548 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 01:57:51.102191 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 01:57:51.129315 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 01:57:51.180638 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 01:57:51.223090 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 01:57:51.250002 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 01:57:51.801973 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 01:57:51.809295 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 01:57:51.820245 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 01:57:51.865655 tst handover.py: using LAC 37741 01:57:51.987556 tst handover.py: using RAC 1 01:57:52.116337 tst handover.py: using CellId 37741 01:57:52.243982 tst handover.py: using BVCI 37742 01:57:52.362182 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 01:57:52.396912 tst handover.py: using LAC 37742 01:57:52.524011 tst handover.py: using RAC 2 01:57:52.650445 tst handover.py: using CellId 37742 01:57:52.776177 tst handover.py: using BVCI 37743 01:57:52.894652 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 01:57:52.906127 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 01:57:52.917179 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 01:57:52.928197 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 01:57:52.939439 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 01:57:52.950455 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 01:57:53.067754 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 01:57:53.186423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:57:53.692020 run create_hlr_db(pid=26649): Launched 01:57:54.873117 run create_hlr_db(pid=26649): Terminated: ok {rc=0} 01:57:55.194922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26651): Launched 01:57:55.500036 run osmo-hlr_10.42.42.2(pid=26652): Launched 01:57:55.618355 run osmo-stp_10.42.42.5: Starting osmo-stp 01:57:56.161149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26654): Launched 01:57:56.466493 run osmo-stp_10.42.42.5(pid=26655): Launched 01:57:56.585871 run osmo-msc_10.42.42.6: Starting osmo-msc 01:57:57.136646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26657): Launched 01:57:57.445780 run osmo-msc_10.42.42.6(pid=26658): Launched 01:57:57.618012 run osmo-stp_10.42.42.5(pid=26655): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26655)] 01:57:57.748082 run osmo-stp_10.42.42.5(pid=26655): stdout: | (launched: 2022-12-14_01:57:56.409684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:57:57.878220 run osmo-stp_10.42.42.5(pid=26655): stderr: | [0;m[38;5;43m20221214015756577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015756577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015756577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015756578 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015756578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015756578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015756578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:57:58.005612 run osmo-stp_10.42.42.5(pid=26655): stdout: | (launched: 2022-12-14_01:57:56.409684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:57:58.127541 run osmo-stp_10.42.42.5(pid=26655): stderr: | [0;m[38;5;43m20221214015756577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015756577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015756577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015756578 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015756578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015756578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015756578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:57:58.272906 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26655): Process ended prematurely: osmo-stp_10.42.42.5(pid=26655) [trial-2397↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26655)] [trial-2397↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 01:57:58.281543 tst handover.py:18: Test FAILED (6.5 sec) 01:57:58.307478 run osmo-hlr_10.42.42.2(pid=26652): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26652)] 01:57:58.355502 run osmo-hlr_10.42.42.2(pid=26652): stdout: | (launched: 2022-12-14_01:57:55.443009) 01:57:58.404260 run osmo-hlr_10.42.42.2(pid=26652): stderr: | [0;m[1;31m20221214015755618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015755618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015755618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015755618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015755618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015755618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015755630 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015755638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015755638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015755638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:57:58.472902 run osmo-msc_10.42.42.6(pid=26658): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26658)] 01:57:58.519720 run osmo-msc_10.42.42.6(pid=26658): stdout: | (launched: 2022-12-14_01:57:57.388710) 01:57:58.568622 run osmo-msc_10.42.42.6(pid=26658): stderr: | [0;m[38;5;43m20221214015757659 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214015757660 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7eff74349c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214015757660 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214015757660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214015757660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214015757660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214015757662 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214015757662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214015757662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214015757663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:57:58.618391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26651): Terminating (SIGTERM) 01:57:58.657998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26654): Terminating (SIGTERM) 01:57:58.697803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26657): Terminating (SIGTERM) 01:57:58.737875 --- ParallelTerminationStrategy: PID 26651 died... 01:57:58.757329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26651): Terminated: ok {rc=0} 01:57:58.801287 --- ParallelTerminationStrategy: PID 26654 died... 01:57:58.820143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26654): Terminated: ok {rc=0} 01:57:58.864043 --- ParallelTerminationStrategy: PID 26657 died... 01:57:58.882999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26657): Terminated: ok {rc=0} 01:57:58.968540 bus /sierra_3: Setting Powered False 01:58:00.067726 bus /sierra_3: Setting Powered False 01:58:01.181747 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 01:58:02.435571 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:58:02.441766 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 01:58:02.482554 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 01:58:02.509977 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 01:58:02.562817 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 01:58:02.602059 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 01:58:02.628724 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 01:58:03.185757 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 01:58:03.192317 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:58:03.204246 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 01:58:03.242635 tst handover.py: using LAC 37743 01:58:03.363633 tst handover.py: using RAC 3 01:58:03.486206 tst handover.py: using CellId 37743 01:58:03.606722 tst handover.py: using BVCI 37744 01:58:03.719293 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 01:58:03.753688 tst handover.py: using LAC 37744 01:58:03.873588 tst handover.py: using RAC 4 01:58:03.993683 tst handover.py: using CellId 37744 01:58:04.113377 tst handover.py: using BVCI 37745 01:58:04.225094 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:58:04.236089 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:58:04.246862 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:58:04.257795 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:58:04.269235 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:58:04.280445 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 01:58:04.399807 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 01:58:04.520309 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:58:04.998481 run create_hlr_db(pid=26663): Launched 01:58:05.124799 bus /sierra_2: Setting Powered False 01:58:06.188720 run create_hlr_db(pid=26663): Terminated: ok {rc=0} 01:58:06.616686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26665): Launched 01:58:06.945373 run osmo-hlr_10.42.42.2(pid=26666): Launched 01:58:07.070933 run osmo-stp_10.42.42.5: Starting osmo-stp 01:58:07.611050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26668): Launched 01:58:07.938425 run osmo-stp_10.42.42.5(pid=26669): Launched 01:58:08.065356 run osmo-msc_10.42.42.6: Starting osmo-msc 01:58:08.630892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26671): Launched 01:58:08.959142 run osmo-msc_10.42.42.6(pid=26672): Launched 01:58:09.141927 run osmo-stp_10.42.42.5(pid=26669): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26669)] 01:58:09.282791 run osmo-stp_10.42.42.5(pid=26669): stdout: | (launched: 2022-12-14_01:58:07.877627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:09.415749 run osmo-stp_10.42.42.5(pid=26669): stderr: | [0;m[38;5;43m20221214015808071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015808071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015808071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015808072 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015808072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015808072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015808072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:09.544292 run osmo-stp_10.42.42.5(pid=26669): stdout: | (launched: 2022-12-14_01:58:07.877627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:09.667009 run osmo-stp_10.42.42.5(pid=26669): stderr: | [0;m[38;5;43m20221214015808071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015808071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015808071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015808072 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015808072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015808072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015808072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:09.813524 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26669): Process ended prematurely: osmo-stp_10.42.42.5(pid=26669) [trial-2397↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26669)] [trial-2397↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 01:58:09.822196 tst handover.py:18: Test FAILED (6.6 sec) 01:58:09.848160 run osmo-hlr_10.42.42.2(pid=26666): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26666)] 01:58:09.896470 run osmo-hlr_10.42.42.2(pid=26666): stdout: | (launched: 2022-12-14_01:58:06.884708) 01:58:09.946323 run osmo-hlr_10.42.42.2(pid=26666): stderr: | [0;m[1;31m20221214015807083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015807083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015807083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015807083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015807083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015807083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015807096 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015807104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015807104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015807104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:58:10.015871 run osmo-msc_10.42.42.6(pid=26672): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26672)] 01:58:10.062962 run osmo-msc_10.42.42.6(pid=26672): stdout: | (launched: 2022-12-14_01:58:08.897876) 01:58:10.112112 run osmo-msc_10.42.42.6(pid=26672): stderr: | [0;m[38;5;43m20221214015809221 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214015809221 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f774f3dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214015809221 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214015809221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214015809221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214015809221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214015809223 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214015809223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214015809223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214015809224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:58:10.161329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26665): Terminating (SIGTERM) 01:58:10.201232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26668): Terminating (SIGTERM) 01:58:10.241102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26671): Terminating (SIGTERM) 01:58:10.281502 --- ParallelTerminationStrategy: PID 26665 died... 01:58:10.301120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26665): Terminated: ok {rc=0} 01:58:10.345749 --- ParallelTerminationStrategy: PID 26668 died... 01:58:10.365032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26668): Terminated: ok {rc=0} 01:58:10.409482 --- ParallelTerminationStrategy: PID 26671 died... 01:58:10.428622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26671): Terminated: ok {rc=0} 01:58:10.513140 bus /sierra_3: Setting Powered False 01:58:11.612169 bus /sierra_3: Setting Powered False 01:58:12.732094 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 01:58:13.974314 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:58:13.979527 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 01:58:14.033386 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 01:58:14.059824 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 01:58:14.111370 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 01:58:14.164076 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 01:58:14.190189 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 01:58:14.741800 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 01:58:14.747124 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:58:14.758498 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 01:58:14.796774 tst handover.py: using LAC 37745 01:58:14.919486 tst handover.py: using RAC 5 01:58:15.041738 tst handover.py: using CellId 37745 01:58:15.171245 tst handover.py: using BVCI 37746 01:58:15.294102 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 01:58:15.342792 tst handover.py: using LAC 37746 01:58:15.472895 tst handover.py: using RAC 6 01:58:15.600722 tst handover.py: using CellId 37746 01:58:15.722549 tst handover.py: using BVCI 37747 01:58:15.836477 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:58:15.860718 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:58:15.879148 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:58:15.895387 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:58:15.911041 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:58:15.922763 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 01:58:16.045434 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 01:58:16.184768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:58:16.706863 run create_hlr_db(pid=26678): Launched 01:58:16.877506 bus /sierra_2: Setting Powered False 01:58:17.938312 run create_hlr_db(pid=26678): Terminated: ok {rc=0} 01:58:18.359448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26680): Launched 01:58:18.690377 run osmo-hlr_10.42.42.2(pid=26681): Launched 01:58:18.814767 run osmo-stp_10.42.42.5: Starting osmo-stp 01:58:19.351111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26683): Launched 01:58:19.678879 run osmo-stp_10.42.42.5(pid=26684): Launched 01:58:19.805766 run osmo-msc_10.42.42.6: Starting osmo-msc 01:58:20.371418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26686): Launched 01:58:20.701907 run osmo-msc_10.42.42.6(pid=26687): Launched 01:58:20.883861 run osmo-stp_10.42.42.5(pid=26684): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26684)] 01:58:21.020831 run osmo-stp_10.42.42.5(pid=26684): stdout: | (launched: 2022-12-14_01:58:19.618365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:21.158782 run osmo-stp_10.42.42.5(pid=26684): stderr: | [0;m[38;5;43m20221214015819811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015819811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015819811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015819812 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015819812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015819812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015819812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:21.296045 run osmo-stp_10.42.42.5(pid=26684): stdout: | (launched: 2022-12-14_01:58:19.618365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:21.426827 run osmo-stp_10.42.42.5(pid=26684): stderr: | [0;m[38;5;43m20221214015819811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015819811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015819811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015819812 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015819812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015819812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015819812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:21.582308 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26684): Process ended prematurely: osmo-stp_10.42.42.5(pid=26684) [trial-2397↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26684)] [trial-2397↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 01:58:21.591247 tst handover.py:18: Test FAILED (6.8 sec) 01:58:21.618452 run osmo-hlr_10.42.42.2(pid=26681): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26681)] 01:58:21.668092 run osmo-hlr_10.42.42.2(pid=26681): stdout: | (launched: 2022-12-14_01:58:18.629606) 01:58:21.719672 run osmo-hlr_10.42.42.2(pid=26681): stderr: | [0;m[1;31m20221214015818829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015818829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015818829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015818829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015818829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015818829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015818853 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015818862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015818862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015818862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:58:21.791436 run osmo-msc_10.42.42.6(pid=26687): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26687)] 01:58:21.840785 run osmo-msc_10.42.42.6(pid=26687): stdout: | (launched: 2022-12-14_01:58:20.640572) 01:58:21.891537 run osmo-msc_10.42.42.6(pid=26687): stderr: | [0;m[38;5;43m20221214015820963 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214015820963 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f64f2b84c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214015820963 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214015820963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214015820963 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214015820964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214015820965 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214015820966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214015820966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214015820966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:58:21.942640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26680): Terminating (SIGTERM) 01:58:21.983677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26683): Terminating (SIGTERM) 01:58:22.024621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26686): Terminating (SIGTERM) 01:58:22.066206 --- ParallelTerminationStrategy: PID 26680 died... 01:58:22.086038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26680): Terminated: ok {rc=0} 01:58:22.131460 --- ParallelTerminationStrategy: PID 26683 died... 01:58:22.150680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26683): Terminated: ok {rc=0} 01:58:22.196167 --- ParallelTerminationStrategy: PID 26686 died... 01:58:22.215762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26686): Terminated: ok {rc=0} 01:58:22.302920 bus /sierra_3: Setting Powered False 01:58:23.401420 bus /sierra_3: Setting Powered False 01:58:24.519268 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 01:58:25.781410 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:58:25.786509 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 01:58:25.836599 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 01:58:25.862911 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 01:58:25.915529 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 01:58:25.968175 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 01:58:25.996245 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 01:58:26.543357 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 01:58:26.548743 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:58:26.559984 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 01:58:26.597396 tst handover.py: using LAC 37747 01:58:26.718849 tst handover.py: using RAC 7 01:58:26.840920 tst handover.py: using CellId 37747 01:58:26.961743 tst handover.py: using BVCI 37748 01:58:27.072913 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 01:58:27.118483 tst handover.py: using LAC 37748 01:58:27.238728 tst handover.py: using RAC 8 01:58:27.358485 tst handover.py: using CellId 37748 01:58:27.480763 tst handover.py: using BVCI 37749 01:58:27.593855 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:58:27.604865 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:58:27.615932 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:58:27.626860 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:58:27.638730 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:58:27.650671 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:58:27.771825 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:58:27.888730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:58:28.337546 run create_hlr_db(pid=26693): Launched 01:58:28.454994 bus /sierra_2: Setting Powered False 01:58:29.515638 run create_hlr_db(pid=26693): Terminated: ok {rc=0} 01:58:29.936206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26695): Launched 01:58:30.266313 run osmo-hlr_10.42.42.2(pid=26696): Launched 01:58:30.393845 run osmo-stp_10.42.42.5: Starting osmo-stp 01:58:30.949330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26698): Launched 01:58:31.272390 run osmo-stp_10.42.42.5(pid=26699): Launched 01:58:31.550800 run osmo-msc_10.42.42.6: Starting osmo-msc 01:58:32.193760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26701): Launched 01:58:32.538182 run osmo-msc_10.42.42.6(pid=26702): Launched 01:58:32.722598 run osmo-stp_10.42.42.5(pid=26699): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26699)] 01:58:32.859230 run osmo-stp_10.42.42.5(pid=26699): stdout: | (launched: 2022-12-14_01:58:31.213935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:32.996873 run osmo-stp_10.42.42.5(pid=26699): stderr: | [0;m[38;5;43m20221214015831494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015831494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015831494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015831495 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015831495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015831495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015831495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:33.133340 run osmo-stp_10.42.42.5(pid=26699): stdout: | (launched: 2022-12-14_01:58:31.213935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:33.263293 run osmo-stp_10.42.42.5(pid=26699): stderr: | [0;m[38;5;43m20221214015831494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015831494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015831494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015831495 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015831495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015831495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015831495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:33.418656 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26699): Process ended prematurely: osmo-stp_10.42.42.5(pid=26699) [trial-2397↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26699)] [trial-2397↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 01:58:33.427659 tst handover.py:18: Test FAILED (6.9 sec) 01:58:33.454762 run osmo-hlr_10.42.42.2(pid=26696): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26696)] 01:58:33.503958 run osmo-hlr_10.42.42.2(pid=26696): stdout: | (launched: 2022-12-14_01:58:30.205062) 01:58:33.554932 run osmo-hlr_10.42.42.2(pid=26696): stderr: | [0;m[1;31m20221214015830404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015830404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015830404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015830404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015830404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015830405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015830418 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015830427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015830427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015830427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:58:33.625976 run osmo-msc_10.42.42.6(pid=26702): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26702)] 01:58:33.675207 run osmo-msc_10.42.42.6(pid=26702): stdout: | (launched: 2022-12-14_01:58:32.477613) 01:58:33.726051 run osmo-msc_10.42.42.6(pid=26702): stderr: | [0;m[38;5;43m20221214015832801 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214015832801 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe199c5ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214015832801 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214015832801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214015832802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214015832802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214015832803 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214015832804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214015832804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214015832804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:58:33.777209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26695): Terminating (SIGTERM) 01:58:33.818219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26698): Terminating (SIGTERM) 01:58:33.859206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26701): Terminating (SIGTERM) 01:58:33.900403 --- ParallelTerminationStrategy: PID 26695 died... 01:58:33.920130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26695): Terminated: ok {rc=0} 01:58:33.965704 --- ParallelTerminationStrategy: PID 26698 died... 01:58:33.985093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26698): Terminated: ok {rc=0} 01:58:34.030283 --- ParallelTerminationStrategy: PID 26701 died... 01:58:34.049501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26701): Terminated: ok {rc=0} 01:58:34.136624 bus /sierra_3: Setting Powered False 01:58:35.235460 bus /sierra_3: Setting Powered False 01:58:36.353754 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 01:58:37.620454 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:58:37.627347 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 01:58:37.683804 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 01:58:37.711024 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 01:58:37.764664 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 01:58:37.818709 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 01:58:37.844761 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 01:58:38.401935 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 01:58:38.408451 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:58:38.420434 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 01:58:38.460429 tst handover.py: using LAC 37749 01:58:38.582817 tst handover.py: using RAC 9 01:58:38.703294 tst handover.py: using CellId 37749 01:58:38.825311 tst handover.py: using BVCI 37750 01:58:38.936934 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 01:58:38.984364 tst handover.py: using LAC 37750 01:58:39.102843 tst handover.py: using RAC 10 01:58:39.222822 tst handover.py: using CellId 37750 01:58:39.342969 tst handover.py: using BVCI 37751 01:58:39.454364 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:58:39.465605 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:58:39.476557 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:58:39.487602 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:58:39.499008 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:58:39.510431 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 01:58:39.629911 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 01:58:39.749826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:58:40.228067 run create_hlr_db(pid=26707): Launched 01:58:40.361807 bus /sierra_2: Setting Powered False 01:58:41.426011 run create_hlr_db(pid=26707): Terminated: ok {rc=0} 01:58:41.853475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26709): Launched 01:58:42.182807 run osmo-hlr_10.42.42.2(pid=26710): Launched 01:58:42.309024 run osmo-stp_10.42.42.5: Starting osmo-stp 01:58:42.842337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26712): Launched 01:58:43.169988 run osmo-stp_10.42.42.5(pid=26713): Launched 01:58:43.296938 run osmo-msc_10.42.42.6: Starting osmo-msc 01:58:43.858206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26715): Launched 01:58:44.185431 run osmo-msc_10.42.42.6(pid=26716): Launched 01:58:44.369653 run osmo-stp_10.42.42.5(pid=26713): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26713)] 01:58:44.506296 run osmo-stp_10.42.42.5(pid=26713): stdout: | (launched: 2022-12-14_01:58:43.109699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:44.643285 run osmo-stp_10.42.42.5(pid=26713): stderr: | [0;m[38;5;43m20221214015843301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015843301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015843301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015843302 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015843302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015843302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015843302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:44.779327 run osmo-stp_10.42.42.5(pid=26713): stdout: | (launched: 2022-12-14_01:58:43.109699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:44.908732 run osmo-stp_10.42.42.5(pid=26713): stderr: | [0;m[38;5;43m20221214015843301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015843301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015843301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015843302 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015843302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015843302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015843302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:45.063916 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26713): Process ended prematurely: osmo-stp_10.42.42.5(pid=26713) [trial-2397↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26713)] [trial-2397↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 01:58:45.072894 tst handover.py:18: Test FAILED (6.7 sec) 01:58:45.100116 run osmo-hlr_10.42.42.2(pid=26710): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26710)] 01:58:45.149392 run osmo-hlr_10.42.42.2(pid=26710): stdout: | (launched: 2022-12-14_01:58:42.121645) 01:58:45.200508 run osmo-hlr_10.42.42.2(pid=26710): stderr: | [0;m[1;31m20221214015842323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015842323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015842323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015842323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015842323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015842323 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015842336 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015842345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015842345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015842345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:58:45.272423 run osmo-msc_10.42.42.6(pid=26716): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26716)] 01:58:45.321806 run osmo-msc_10.42.42.6(pid=26716): stdout: | (launched: 2022-12-14_01:58:44.124735) 01:58:45.372849 run osmo-msc_10.42.42.6(pid=26716): stderr: | [0;m[38;5;43m20221214015844449 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214015844449 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3a581ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214015844449 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214015844449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214015844449 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214015844450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214015844451 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214015844452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214015844452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214015844452 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:58:45.424362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26709): Terminating (SIGTERM) 01:58:45.465660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26712): Terminating (SIGTERM) 01:58:45.506716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26715): Terminating (SIGTERM) 01:58:45.547986 --- ParallelTerminationStrategy: PID 26709 died... 01:58:45.567801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26709): Terminated: ok {rc=0} 01:58:45.613128 --- ParallelTerminationStrategy: PID 26712 died... 01:58:45.632224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26712): Terminated: ok {rc=0} 01:58:45.677477 --- ParallelTerminationStrategy: PID 26715 died... 01:58:45.696611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26715): Terminated: ok {rc=0} 01:58:45.783097 bus /sierra_3: Setting Powered False 01:58:46.886630 bus /sierra_3: Setting Powered False 01:58:48.011852 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 01:58:49.277195 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:58:49.283334 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 01:58:49.325674 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 01:58:49.352169 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 01:58:49.403591 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 01:58:49.445868 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 01:58:49.473170 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 01:58:50.022897 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 01:58:50.028291 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:58:50.039300 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 01:58:50.076612 tst handover.py: using LAC 37751 01:58:50.201215 tst handover.py: using RAC 11 01:58:50.320887 tst handover.py: using CellId 37751 01:58:50.439071 tst handover.py: using BVCI 37752 01:58:50.549694 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 01:58:50.583671 tst handover.py: using LAC 37752 01:58:50.702177 tst handover.py: using RAC 12 01:58:50.822174 tst handover.py: using CellId 37752 01:58:50.942849 tst handover.py: using BVCI 37753 01:58:51.054756 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:58:51.065788 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:58:51.076502 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:58:51.087150 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:58:51.098371 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 01:58:51.109505 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 01:58:51.229409 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 01:58:51.346913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:58:51.793056 run create_hlr_db(pid=26721): Launched 01:58:51.908281 bus /sierra_2: Setting Powered False 01:58:52.969193 run create_hlr_db(pid=26721): Terminated: ok {rc=0} 01:58:53.388647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26723): Launched 01:58:53.717967 run osmo-hlr_10.42.42.2(pid=26724): Launched 01:58:53.842561 run osmo-stp_10.42.42.5: Starting osmo-stp 01:58:54.379704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26726): Launched 01:58:54.707725 run osmo-stp_10.42.42.5(pid=26727): Launched 01:58:54.832885 run osmo-msc_10.42.42.6: Starting osmo-msc 01:58:55.395274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26729): Launched 01:58:55.723580 run osmo-msc_10.42.42.6(pid=26730): Launched 01:58:55.907300 run osmo-stp_10.42.42.5(pid=26727): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26727)] 01:58:56.044024 run osmo-stp_10.42.42.5(pid=26727): stdout: | (launched: 2022-12-14_01:58:54.647552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:56.181518 run osmo-stp_10.42.42.5(pid=26727): stderr: | [0;m[38;5;43m20221214015854841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015854841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015854841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015854842 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015854842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015854842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015854842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:56.317870 run osmo-stp_10.42.42.5(pid=26727): stdout: | (launched: 2022-12-14_01:58:54.647552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:58:56.447862 run osmo-stp_10.42.42.5(pid=26727): stderr: | [0;m[38;5;43m20221214015854841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015854841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015854841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015854842 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015854842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015854842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015854842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:58:56.603169 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26727): Process ended prematurely: osmo-stp_10.42.42.5(pid=26727) [trial-2397↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26727)] [trial-2397↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 01:58:56.611902 tst handover.py:18: Test FAILED (6.6 sec) 01:58:56.639019 run osmo-hlr_10.42.42.2(pid=26724): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26724)] 01:58:56.688049 run osmo-hlr_10.42.42.2(pid=26724): stdout: | (launched: 2022-12-14_01:58:53.657080) 01:58:56.739288 run osmo-hlr_10.42.42.2(pid=26724): stderr: | [0;m[1;31m20221214015853855 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015853855 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015853855 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015853855 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015853855 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015853855 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015853869 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015853877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015853877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015853877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:58:56.810270 run osmo-msc_10.42.42.6(pid=26730): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26730)] 01:58:56.859268 run osmo-msc_10.42.42.6(pid=26730): stdout: | (launched: 2022-12-14_01:58:55.663283) 01:58:56.910048 run osmo-msc_10.42.42.6(pid=26730): stderr: | [0;m[38;5;43m20221214015855983 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214015855983 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3ab57d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214015855983 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214015855983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214015855983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214015855984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214015855986 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214015855986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214015855986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214015855986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:58:56.961860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26723): Terminating (SIGTERM) 01:58:57.002881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26726): Terminating (SIGTERM) 01:58:57.043966 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26729): Terminating (SIGTERM) 01:58:57.085515 --- ParallelTerminationStrategy: PID 26723 died... 01:58:57.105468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26723): Terminated: ok {rc=0} 01:58:57.151306 --- ParallelTerminationStrategy: PID 26726 died... 01:58:57.170710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26726): Terminated: ok {rc=0} 01:58:57.216426 --- ParallelTerminationStrategy: PID 26729 died... 01:58:57.236252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26729): Terminated: ok {rc=0} 01:58:57.324294 bus /sierra_3: Setting Powered False 01:58:58.423091 bus /sierra_3: Setting Powered False 01:58:59.540020 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 01:59:00.793888 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:59:00.799516 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 01:59:00.855420 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 01:59:00.891586 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 01:59:00.953870 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 01:59:01.015552 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 01:59:01.043889 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 01:59:01.583024 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 01:59:01.590158 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:59:01.605520 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 01:59:01.658220 tst handover.py: using LAC 37753 01:59:01.816108 tst handover.py: using RAC 13 01:59:01.979758 tst handover.py: using CellId 37753 01:59:02.112395 tst handover.py: using BVCI 37754 01:59:02.235815 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 01:59:02.283879 tst handover.py: using LAC 37754 01:59:02.406182 tst handover.py: using RAC 14 01:59:02.527547 tst handover.py: using CellId 37754 01:59:02.646393 tst handover.py: using BVCI 37755 01:59:02.760486 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:59:02.771450 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:59:02.782539 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:59:02.793186 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:59:02.804596 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 01:59:02.816091 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 01:59:02.938599 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 01:59:03.055338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:59:03.502495 run create_hlr_db(pid=26735): Launched 01:59:03.619392 bus /sierra_2: Setting Powered False 01:59:04.679858 run create_hlr_db(pid=26735): Terminated: ok {rc=0} 01:59:05.099587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26737): Launched 01:59:05.427462 run osmo-hlr_10.42.42.2(pid=26738): Launched 01:59:05.552129 run osmo-stp_10.42.42.5: Starting osmo-stp 01:59:06.084485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26740): Launched 01:59:06.412553 run osmo-stp_10.42.42.5(pid=26741): Launched 01:59:06.537540 run osmo-msc_10.42.42.6: Starting osmo-msc 01:59:07.101449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26743): Launched 01:59:07.432233 run osmo-msc_10.42.42.6(pid=26744): Launched 01:59:07.616866 run osmo-stp_10.42.42.5(pid=26741): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26741)] 01:59:07.754242 run osmo-stp_10.42.42.5(pid=26741): stdout: | (launched: 2022-12-14_01:59:06.351579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:07.891118 run osmo-stp_10.42.42.5(pid=26741): stderr: | [0;m[38;5;43m20221214015906543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015906543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015906544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015906544 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015906545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015906545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015906545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:08.026909 run osmo-stp_10.42.42.5(pid=26741): stdout: | (launched: 2022-12-14_01:59:06.351579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:08.157198 run osmo-stp_10.42.42.5(pid=26741): stderr: | [0;m[38;5;43m20221214015906543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015906543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015906544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015906544 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015906545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015906545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015906545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:08.313125 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26741): Process ended prematurely: osmo-stp_10.42.42.5(pid=26741) [trial-2397↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26741)] [trial-2397↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 01:59:08.322138 tst handover.py:18: Test FAILED (6.7 sec) 01:59:08.349205 run osmo-hlr_10.42.42.2(pid=26738): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26738)] 01:59:08.398747 run osmo-hlr_10.42.42.2(pid=26738): stdout: | (launched: 2022-12-14_01:59:05.366612) 01:59:08.450408 run osmo-hlr_10.42.42.2(pid=26738): stderr: | [0;m[1;31m20221214015905563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015905563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015905564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015905564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015905564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015905564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015905579 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015905589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015905589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015905589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:59:08.521679 run osmo-msc_10.42.42.6(pid=26744): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26744)] 01:59:08.571009 run osmo-msc_10.42.42.6(pid=26744): stdout: | (launched: 2022-12-14_01:59:07.371062) 01:59:08.621891 run osmo-msc_10.42.42.6(pid=26744): stderr: | [0;m[38;5;43m20221214015907692 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214015907692 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f449b3c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214015907692 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214015907692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214015907692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214015907693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214015907694 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214015907695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214015907695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214015907695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:59:08.673290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26737): Terminating (SIGTERM) 01:59:08.714448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26740): Terminating (SIGTERM) 01:59:08.755526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26743): Terminating (SIGTERM) 01:59:08.796577 --- ParallelTerminationStrategy: PID 26737 died... 01:59:08.816346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26737): Terminated: ok {rc=0} 01:59:08.861718 --- ParallelTerminationStrategy: PID 26740 died... 01:59:08.880692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26740): Terminated: ok {rc=0} 01:59:08.926225 --- ParallelTerminationStrategy: PID 26743 died... 01:59:08.945728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26743): Terminated: ok {rc=0} 01:59:09.032601 bus /sierra_3: Setting Powered False 01:59:10.131080 bus /sierra_3: Setting Powered False 01:59:11.246118 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 01:59:12.502029 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:59:12.508147 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 01:59:12.562050 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 01:59:12.589404 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 01:59:12.643217 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 01:59:12.698486 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 01:59:12.725888 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 01:59:13.272227 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 01:59:13.277823 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 01:59:13.288826 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 01:59:13.327238 tst handover.py: using LAC 37755 01:59:13.449430 tst handover.py: using RAC 15 01:59:13.580037 tst handover.py: using CellId 37755 01:59:13.714516 tst handover.py: using BVCI 37756 01:59:13.833466 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 01:59:13.880882 tst handover.py: using LAC 37756 01:59:14.008440 tst handover.py: using RAC 16 01:59:14.135276 tst handover.py: using CellId 37756 01:59:14.261812 tst handover.py: using BVCI 37757 01:59:14.380749 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 01:59:14.392172 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 01:59:14.403393 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 01:59:14.414722 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 01:59:14.425987 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 01:59:14.437251 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 01:59:14.554834 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 01:59:14.670634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:59:15.118380 run create_hlr_db(pid=26749): Launched 01:59:15.256242 bus /sierra_2: Setting Powered False 01:59:16.318949 run create_hlr_db(pid=26749): Terminated: ok {rc=0} 01:59:16.756041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26751): Launched 01:59:17.102243 run osmo-hlr_10.42.42.2(pid=26752): Launched 01:59:17.257411 run osmo-stp_10.42.42.5: Starting osmo-stp 01:59:17.767922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26754): Launched 01:59:18.075203 run osmo-stp_10.42.42.5(pid=26755): Launched 01:59:18.194571 run osmo-msc_10.42.42.6: Starting osmo-msc 01:59:18.721562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26757): Launched 01:59:19.031493 run osmo-msc_10.42.42.6(pid=26758): Launched 01:59:19.205327 run osmo-stp_10.42.42.5(pid=26755): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26755)] 01:59:19.334497 run osmo-stp_10.42.42.5(pid=26755): stdout: | (launched: 2022-12-14_01:59:18.018007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:19.463843 run osmo-stp_10.42.42.5(pid=26755): stderr: | [0;m[38;5;43m20221214015918188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015918188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015918188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015918189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015918189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015918189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015918189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:19.591258 run osmo-stp_10.42.42.5(pid=26755): stdout: | (launched: 2022-12-14_01:59:18.018007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:19.712783 run osmo-stp_10.42.42.5(pid=26755): stderr: | [0;m[38;5;43m20221214015918188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015918188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015918188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015918189 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015918189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015918189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015918189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:19.858791 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26755): Process ended prematurely: osmo-stp_10.42.42.5(pid=26755) [trial-2397↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26755)] [trial-2397↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 01:59:19.867323 tst handover.py:18: Test FAILED (6.6 sec) 01:59:19.893282 run osmo-hlr_10.42.42.2(pid=26752): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26752)] 01:59:19.941356 run osmo-hlr_10.42.42.2(pid=26752): stdout: | (launched: 2022-12-14_01:59:17.039475) 01:59:19.990660 run osmo-hlr_10.42.42.2(pid=26752): stderr: | [0;m[1;31m20221214015917231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015917231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015917231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015917231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015917231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015917231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015917244 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015917252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015917252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015917252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:59:20.059456 run osmo-msc_10.42.42.6(pid=26758): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26758)] 01:59:20.106826 run osmo-msc_10.42.42.6(pid=26758): stdout: | (launched: 2022-12-14_01:59:18.974375) 01:59:20.155596 run osmo-msc_10.42.42.6(pid=26758): stderr: | [0;m[38;5;43m20221214015919246 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214015919246 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe284a50c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214015919246 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214015919246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214015919246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214015919246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214015919248 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214015919248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214015919249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214015919249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:59:20.205008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26751): Terminating (SIGTERM) 01:59:20.244853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26754): Terminating (SIGTERM) 01:59:20.284309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26757): Terminating (SIGTERM) 01:59:20.324243 --- ParallelTerminationStrategy: PID 26751 died... 01:59:20.343981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26751): Terminated: ok {rc=0} 01:59:20.388087 --- ParallelTerminationStrategy: PID 26754 died... 01:59:20.407044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26754): Terminated: ok {rc=0} 01:59:20.451002 --- ParallelTerminationStrategy: PID 26757 died... 01:59:20.469984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26757): Terminated: ok {rc=0} 01:59:20.556165 bus /sierra_3: Setting Powered False 01:59:21.655595 bus /sierra_3: Setting Powered False 01:59:22.770540 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 01:59:24.035464 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:59:24.041020 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 01:59:24.078611 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 01:59:24.105833 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 01:59:24.159595 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 01:59:24.197406 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 01:59:24.224650 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 01:59:24.774440 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 01:59:24.780198 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:59:24.791659 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 01:59:24.827399 tst handover.py: using LAC 37757 01:59:24.955999 tst handover.py: using RAC 17 01:59:25.084800 tst handover.py: using CellId 37757 01:59:25.212534 tst handover.py: using BVCI 37758 01:59:25.331398 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 01:59:25.367596 tst handover.py: using LAC 37758 01:59:25.495396 tst handover.py: using RAC 18 01:59:25.623041 tst handover.py: using CellId 37758 01:59:25.752137 tst handover.py: using BVCI 37759 01:59:25.870794 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:59:25.882078 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:59:25.893133 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:59:25.904148 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:59:25.915178 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 01:59:25.926514 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 01:59:26.042582 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 01:59:26.165939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:59:26.648416 run create_hlr_db(pid=26763): Launched 01:59:26.782816 bus /sierra_2: Setting Powered False 01:59:27.847501 run create_hlr_db(pid=26763): Terminated: ok {rc=0} 01:59:28.261213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26765): Launched 01:59:28.567692 run osmo-hlr_10.42.42.2(pid=26766): Launched 01:59:28.685464 run osmo-stp_10.42.42.5: Starting osmo-stp 01:59:29.201495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26768): Launched 01:59:29.508620 run osmo-stp_10.42.42.5(pid=26769): Launched 01:59:29.626075 run osmo-msc_10.42.42.6: Starting osmo-msc 01:59:30.152763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26771): Launched 01:59:30.459403 run osmo-msc_10.42.42.6(pid=26772): Launched 01:59:30.634211 run osmo-stp_10.42.42.5(pid=26769): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26769)] 01:59:30.764148 run osmo-stp_10.42.42.5(pid=26769): stdout: | (launched: 2022-12-14_01:59:29.450740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:30.903335 run osmo-stp_10.42.42.5(pid=26769): stderr: | [0;m[38;5;43m20221214015929621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015929622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015929622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015929622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015929623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015929623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015929623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:31.040435 run osmo-stp_10.42.42.5(pid=26769): stdout: | (launched: 2022-12-14_01:59:29.450740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:31.167633 run osmo-stp_10.42.42.5(pid=26769): stderr: | [0;m[38;5;43m20221214015929621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015929622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015929622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015929622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015929623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015929623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015929623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:31.318586 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26769): Process ended prematurely: osmo-stp_10.42.42.5(pid=26769) [trial-2397↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26769)] [trial-2397↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 01:59:31.327794 tst handover.py:18: Test FAILED (6.5 sec) 01:59:31.354673 run osmo-hlr_10.42.42.2(pid=26766): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26766)] 01:59:31.405605 run osmo-hlr_10.42.42.2(pid=26766): stdout: | (launched: 2022-12-14_01:59:28.510709) 01:59:31.456163 run osmo-hlr_10.42.42.2(pid=26766): stderr: | [0;m[1;31m20221214015928685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015928685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015928685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015928685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015928685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015928685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015928697 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015928705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015928706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015928706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:59:31.527499 run osmo-msc_10.42.42.6(pid=26772): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26772)] 01:59:31.576268 run osmo-msc_10.42.42.6(pid=26772): stdout: | (launched: 2022-12-14_01:59:30.402676) 01:59:31.628264 run osmo-msc_10.42.42.6(pid=26772): stderr: | [0;m[38;5;43m20221214015930673 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214015930673 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd5acf4bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214015930673 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214015930673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214015930674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214015930674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214015930675 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214015930676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214015930676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214015930676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:59:31.680435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26765): Terminating (SIGTERM) 01:59:31.721392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26768): Terminating (SIGTERM) 01:59:31.762489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26771): Terminating (SIGTERM) 01:59:31.804004 --- ParallelTerminationStrategy: PID 26765 died... 01:59:31.824326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26765): Terminated: ok {rc=0} 01:59:31.870260 --- ParallelTerminationStrategy: PID 26768 died... 01:59:31.890732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26768): Terminated: ok {rc=0} 01:59:31.936495 --- ParallelTerminationStrategy: PID 26771 died... 01:59:31.957034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26771): Terminated: ok {rc=0} 01:59:32.043500 bus /sierra_3: Setting Powered False 01:59:33.140408 bus /sierra_3: Setting Powered False 01:59:34.255444 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 01:59:35.490182 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:59:35.495385 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 01:59:35.546242 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 01:59:35.572479 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 01:59:35.624280 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 01:59:35.674560 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 01:59:35.700824 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 01:59:36.255189 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 01:59:36.260793 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:59:36.272156 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 01:59:36.306662 tst handover.py: using LAC 37759 01:59:36.436405 tst handover.py: using RAC 19 01:59:36.565160 tst handover.py: using CellId 37759 01:59:36.693048 tst handover.py: using BVCI 37760 01:59:36.813430 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 01:59:36.862765 tst handover.py: using LAC 37760 01:59:36.992688 tst handover.py: using RAC 20 01:59:37.120285 tst handover.py: using CellId 37760 01:59:37.248089 tst handover.py: using BVCI 37761 01:59:37.367070 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:59:37.378573 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:59:37.389627 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:59:37.400550 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:59:37.411714 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 01:59:37.422936 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 01:59:37.538745 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 01:59:37.654339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:59:38.101605 run create_hlr_db(pid=26778): Launched 01:59:38.218825 bus /sierra_2: Setting Powered False 01:59:39.279162 run create_hlr_db(pid=26778): Terminated: ok {rc=0} 01:59:39.699672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26780): Launched 01:59:40.029630 run osmo-hlr_10.42.42.2(pid=26781): Launched 01:59:40.155029 run osmo-stp_10.42.42.5: Starting osmo-stp 01:59:40.695218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26783): Launched 01:59:41.022456 run osmo-stp_10.42.42.5(pid=26784): Launched 01:59:41.148078 run osmo-msc_10.42.42.6: Starting osmo-msc 01:59:41.710836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26786): Launched 01:59:42.040083 run osmo-msc_10.42.42.6(pid=26787): Launched 01:59:42.224652 run osmo-stp_10.42.42.5(pid=26784): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26784)] 01:59:42.363484 run osmo-stp_10.42.42.5(pid=26784): stdout: | (launched: 2022-12-14_01:59:40.961983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:42.505738 run osmo-stp_10.42.42.5(pid=26784): stderr: | [0;m[38;5;43m20221214015941154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015941154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015941155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015941155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015941155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015941156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015941156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:42.642999 run osmo-stp_10.42.42.5(pid=26784): stdout: | (launched: 2022-12-14_01:59:40.961983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:42.773296 run osmo-stp_10.42.42.5(pid=26784): stderr: | [0;m[38;5;43m20221214015941154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015941154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015941155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015941155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015941155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015941156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015941156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:42.928651 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26784): Process ended prematurely: osmo-stp_10.42.42.5(pid=26784) [trial-2397↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26784)] [trial-2397↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 01:59:42.937832 tst handover.py:18: Test FAILED (6.7 sec) 01:59:42.964855 run osmo-hlr_10.42.42.2(pid=26781): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26781)] 01:59:43.014111 run osmo-hlr_10.42.42.2(pid=26781): stdout: | (launched: 2022-12-14_01:59:39.968428) 01:59:43.065179 run osmo-hlr_10.42.42.2(pid=26781): stderr: | [0;m[1;31m20221214015940168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015940168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015940168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015940168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015940168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015940168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015940181 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015940191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015940191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015940191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:59:43.136426 run osmo-msc_10.42.42.6(pid=26787): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26787)] 01:59:43.185492 run osmo-msc_10.42.42.6(pid=26787): stdout: | (launched: 2022-12-14_01:59:41.979362) 01:59:43.236147 run osmo-msc_10.42.42.6(pid=26787): stderr: | [0;m[38;5;43m20221214015942304 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214015942304 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff48dc3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214015942304 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214015942304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214015942304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214015942304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214015942306 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214015942313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214015942313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214015942313 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:59:43.287578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26780): Terminating (SIGTERM) 01:59:43.328554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26783): Terminating (SIGTERM) 01:59:43.369434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26786): Terminating (SIGTERM) 01:59:43.411021 --- ParallelTerminationStrategy: PID 26780 died... 01:59:43.430787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26780): Terminated: ok {rc=0} 01:59:43.476461 --- ParallelTerminationStrategy: PID 26783 died... 01:59:43.495686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26783): Terminated: ok {rc=0} 01:59:43.540770 --- ParallelTerminationStrategy: PID 26786 died... 01:59:43.559995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26786): Terminated: ok {rc=0} 01:59:43.646518 bus /sierra_3: Setting Powered False 01:59:44.744062 bus /sierra_3: Setting Powered False 01:59:45.870137 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 01:59:47.180942 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:59:47.186229 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 01:59:47.235113 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 01:59:47.262262 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 01:59:47.314656 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 01:59:47.362319 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 01:59:47.388678 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 01:59:47.938445 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 01:59:47.943967 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:59:47.955387 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 01:59:47.989641 tst handover.py: using LAC 37761 01:59:48.120822 tst handover.py: using RAC 21 01:59:48.248325 tst handover.py: using CellId 37761 01:59:48.377734 tst handover.py: using BVCI 37762 01:59:48.497244 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 01:59:48.542556 tst handover.py: using LAC 37762 01:59:48.669465 tst handover.py: using RAC 22 01:59:48.790640 tst handover.py: using CellId 37762 01:59:48.912422 tst handover.py: using BVCI 37763 01:59:49.025330 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:59:49.036463 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:59:49.047544 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:59:49.058659 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:59:49.070026 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 01:59:49.081336 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:59:49.199797 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 01:59:49.317497 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:59:49.775437 run create_hlr_db(pid=26792): Launched 01:59:49.892512 bus /sierra_2: Setting Powered False 01:59:50.953625 run create_hlr_db(pid=26792): Terminated: ok {rc=0} 01:59:51.357714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26794): Launched 01:59:51.664831 run osmo-hlr_10.42.42.2(pid=26795): Launched 01:59:51.781869 run osmo-stp_10.42.42.5: Starting osmo-stp 01:59:52.296857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26797): Launched 01:59:52.604467 run osmo-stp_10.42.42.5(pid=26798): Launched 01:59:52.722691 run osmo-msc_10.42.42.6: Starting osmo-msc 01:59:53.250653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26800): Launched 01:59:53.559620 run osmo-msc_10.42.42.6(pid=26801): Launched 01:59:53.732380 run osmo-stp_10.42.42.5(pid=26798): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26798)] 01:59:53.861774 run osmo-stp_10.42.42.5(pid=26798): stdout: | (launched: 2022-12-14_01:59:52.547458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:53.991655 run osmo-stp_10.42.42.5(pid=26798): stderr: | [0;m[38;5;43m20221214015952718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015952718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015952718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015952718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015952719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015952719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015952719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:54.118969 run osmo-stp_10.42.42.5(pid=26798): stdout: | (launched: 2022-12-14_01:59:52.547458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 01:59:54.241104 run osmo-stp_10.42.42.5(pid=26798): stderr: | [0;m[38;5;43m20221214015952718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214015952718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214015952718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214015952718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214015952719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214015952719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214015952719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 01:59:54.386968 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26798): Process ended prematurely: osmo-stp_10.42.42.5(pid=26798) [trial-2397↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26798)] [trial-2397↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 01:59:54.395473 tst handover.py:18: Test FAILED (6.4 sec) 01:59:54.421627 run osmo-hlr_10.42.42.2(pid=26795): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26795)] 01:59:54.469764 run osmo-hlr_10.42.42.2(pid=26795): stdout: | (launched: 2022-12-14_01:59:51.607930) 01:59:54.519311 run osmo-hlr_10.42.42.2(pid=26795): stderr: | [0;m[1;31m20221214015951783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214015951783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214015951783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214015951783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214015951783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214015951784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214015951804 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214015951814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214015951814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214015951814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 01:59:54.588110 run osmo-msc_10.42.42.6(pid=26801): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26801)] 01:59:54.635306 run osmo-msc_10.42.42.6(pid=26801): stdout: | (launched: 2022-12-14_01:59:53.502562) 01:59:54.684459 run osmo-msc_10.42.42.6(pid=26801): stderr: | [0;m[38;5;43m20221214015953776 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214015953776 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3db0a3ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214015953776 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214015953777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214015953777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214015953777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214015953779 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214015953779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214015953779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214015953779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 01:59:54.734340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26794): Terminating (SIGTERM) 01:59:54.774324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26797): Terminating (SIGTERM) 01:59:54.814227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26800): Terminating (SIGTERM) 01:59:54.854316 --- ParallelTerminationStrategy: PID 26794 died... 01:59:54.873885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26794): Terminated: ok {rc=0} 01:59:54.917978 --- ParallelTerminationStrategy: PID 26797 died... 01:59:54.937080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26797): Terminated: ok {rc=0} 01:59:54.981177 --- ParallelTerminationStrategy: PID 26800 died... 01:59:55.000119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26800): Terminated: ok {rc=0} 01:59:55.086465 bus /sierra_3: Setting Powered False 01:59:56.184026 bus /sierra_3: Setting Powered False 01:59:57.299222 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 01:59:58.555630 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:59:58.560886 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 01:59:58.612526 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 01:59:58.638945 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 01:59:58.691917 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 01:59:58.743756 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 01:59:58.770232 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 01:59:59.319377 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 01:59:59.324815 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 01:59:59.336012 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 01:59:59.370916 tst handover.py: using LAC 37763 01:59:59.492595 tst handover.py: using RAC 23 01:59:59.614282 tst handover.py: using CellId 37763 01:59:59.738846 tst handover.py: using BVCI 37764 01:59:59.850570 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 01:59:59.898028 tst handover.py: using LAC 37764 02:00:00.021511 tst handover.py: using RAC 24 02:00:00.149200 tst handover.py: using CellId 37764 02:00:00.276764 tst handover.py: using BVCI 37765 02:00:00.396107 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:00:00.407497 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:00:00.419186 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:00:00.430425 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:00:00.441789 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:00:00.452919 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:00:00.568437 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:00:00.685060 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:00:01.149644 run create_hlr_db(pid=26806): Launched 02:00:01.308543 bus /sierra_2: Setting Powered False 02:00:02.370100 run create_hlr_db(pid=26806): Terminated: ok {rc=0} 02:00:02.772031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26811): Launched 02:00:03.079448 run osmo-hlr_10.42.42.2(pid=26812): Launched 02:00:03.198281 run osmo-stp_10.42.42.5: Starting osmo-stp 02:00:03.715594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26814): Launched 02:00:04.023294 run osmo-stp_10.42.42.5(pid=26815): Launched 02:00:04.142417 run osmo-msc_10.42.42.6: Starting osmo-msc 02:00:04.668415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26817): Launched 02:00:04.975867 run osmo-msc_10.42.42.6(pid=26818): Launched 02:00:05.147370 run osmo-stp_10.42.42.5(pid=26815): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26815)] 02:00:05.276240 run osmo-stp_10.42.42.5(pid=26815): stdout: | (launched: 2022-12-14_02:00:03.966457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:05.405831 run osmo-stp_10.42.42.5(pid=26815): stderr: | [0;m[38;5;43m20221214020004138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020004138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020004138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020004139 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020004139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020004139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020004139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:05.533490 run osmo-stp_10.42.42.5(pid=26815): stdout: | (launched: 2022-12-14_02:00:03.966457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:05.655037 run osmo-stp_10.42.42.5(pid=26815): stderr: | [0;m[38;5;43m20221214020004138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020004138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020004138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020004139 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020004139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020004139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020004139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:05.800488 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26815): Process ended prematurely: osmo-stp_10.42.42.5(pid=26815) [trial-2397↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26815)] [trial-2397↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 02:00:05.808734 tst handover.py:18: Test FAILED (6.5 sec) 02:00:05.834624 run osmo-hlr_10.42.42.2(pid=26812): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26812)] 02:00:05.881732 run osmo-hlr_10.42.42.2(pid=26812): stdout: | (launched: 2022-12-14_02:00:03.022610) 02:00:05.930676 run osmo-hlr_10.42.42.2(pid=26812): stderr: | [0;m[1;31m20221214020003200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020003200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020003200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020003200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020003200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020003200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020003212 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020003220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020003220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020003220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:00:05.998765 run osmo-msc_10.42.42.6(pid=26818): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26818)] 02:00:06.046163 run osmo-msc_10.42.42.6(pid=26818): stdout: | (launched: 2022-12-14_02:00:04.918678) 02:00:06.094861 run osmo-msc_10.42.42.6(pid=26818): stderr: | [0;m[38;5;43m20221214020005190 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020005190 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f085dd29c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020005190 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020005190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020005190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020005190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020005192 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020005192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020005193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020005193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:00:06.143925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26811): Terminating (SIGTERM) 02:00:06.183319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26814): Terminating (SIGTERM) 02:00:06.222685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26817): Terminating (SIGTERM) 02:00:06.262304 --- ParallelTerminationStrategy: PID 26811 died... 02:00:06.281847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26811): Terminated: ok {rc=0} 02:00:06.326037 --- ParallelTerminationStrategy: PID 26814 died... 02:00:06.344923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26814): Terminated: ok {rc=0} 02:00:06.388727 --- ParallelTerminationStrategy: PID 26817 died... 02:00:06.407622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26817): Terminated: ok {rc=0} 02:00:06.491022 bus /sierra_3: Setting Powered False 02:00:07.589217 bus /sierra_3: Setting Powered False 02:00:08.705267 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 02:00:09.969051 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:00:09.974535 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 02:00:10.013785 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 02:00:10.041268 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 02:00:10.095311 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 02:00:10.135012 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 02:00:10.162430 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 02:00:10.709175 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 02:00:10.714593 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:00:10.725573 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 02:00:10.762686 tst handover.py: using LAC 37765 02:00:10.890470 tst handover.py: using RAC 25 02:00:11.017467 tst handover.py: using CellId 37765 02:00:11.149017 tst handover.py: using BVCI 37766 02:00:11.270202 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 02:00:11.305171 tst handover.py: using LAC 37766 02:00:11.431687 tst handover.py: using RAC 26 02:00:11.551058 tst handover.py: using CellId 37766 02:00:11.670485 tst handover.py: using BVCI 37767 02:00:11.789603 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:00:11.800716 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:00:11.811767 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:00:11.822889 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:00:11.833991 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:00:11.845030 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 02:00:11.963620 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 02:00:12.083739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:00:12.565276 run create_hlr_db(pid=26823): Launched 02:00:12.699867 bus /sierra_2: Setting Powered False 02:00:13.764157 run create_hlr_db(pid=26823): Terminated: ok {rc=0} 02:00:14.178506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26825): Launched 02:00:14.485887 run osmo-hlr_10.42.42.2(pid=26826): Launched 02:00:14.603409 run osmo-stp_10.42.42.5: Starting osmo-stp 02:00:15.123358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26828): Launched 02:00:15.431887 run osmo-stp_10.42.42.5(pid=26829): Launched 02:00:15.549792 run osmo-msc_10.42.42.6: Starting osmo-msc 02:00:16.093761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26831): Launched 02:00:16.439908 run osmo-msc_10.42.42.6(pid=26832): Launched 02:00:16.831420 run osmo-stp_10.42.42.5(pid=26829): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26829)] 02:00:17.124134 run osmo-stp_10.42.42.5(pid=26829): stdout: | (launched: 2022-12-14_02:00:15.374414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:17.256540 run osmo-stp_10.42.42.5(pid=26829): stderr: | [0;m[38;5;43m20221214020015545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020015545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020015545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020015546 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020015546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020015546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020015546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:17.390870 run osmo-stp_10.42.42.5(pid=26829): stdout: | (launched: 2022-12-14_02:00:15.374414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:17.512513 run osmo-stp_10.42.42.5(pid=26829): stderr: | [0;m[38;5;43m20221214020015545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020015545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020015545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020015546 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020015546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020015546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020015546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:17.658780 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26829): Process ended prematurely: osmo-stp_10.42.42.5(pid=26829) [trial-2397↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26829)] [trial-2397↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 02:00:17.667451 tst handover.py:18: Test FAILED (6.9 sec) 02:00:17.693688 run osmo-hlr_10.42.42.2(pid=26826): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26826)] 02:00:17.741892 run osmo-hlr_10.42.42.2(pid=26826): stdout: | (launched: 2022-12-14_02:00:14.428400) 02:00:17.791097 run osmo-hlr_10.42.42.2(pid=26826): stderr: | [0;m[1;31m20221214020014604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020014604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020014604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020014604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020014604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020014604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020014617 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020014625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020014626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020014626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:00:17.860693 run osmo-msc_10.42.42.6(pid=26832): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26832)] 02:00:17.908153 run osmo-msc_10.42.42.6(pid=26832): stdout: | (launched: 2022-12-14_02:00:16.376869) 02:00:17.957595 run osmo-msc_10.42.42.6(pid=26832): stderr: | [0;m[38;5;43m20221214020016775 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020016775 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0357fc0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020016775 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020016775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020016775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020016775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020016779 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020016782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020016783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020016784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:00:18.007223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26825): Terminating (SIGTERM) 02:00:18.047194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26828): Terminating (SIGTERM) 02:00:18.087166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26831): Terminating (SIGTERM) 02:00:18.127131 --- ParallelTerminationStrategy: PID 26825 died... 02:00:18.146640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26825): Terminated: ok {rc=0} 02:00:18.190712 --- ParallelTerminationStrategy: PID 26828 died... 02:00:18.209615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26828): Terminated: ok {rc=0} 02:00:18.253612 --- ParallelTerminationStrategy: PID 26831 died... 02:00:18.272565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26831): Terminated: ok {rc=0} 02:00:18.358521 bus /sierra_3: Setting Powered False 02:00:19.456378 bus /sierra_3: Setting Powered False 02:00:20.570880 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 02:00:21.811941 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:00:21.817386 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 02:00:21.867742 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 02:00:21.894170 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 02:00:21.946789 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 02:00:21.999547 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 02:00:22.026870 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 02:00:22.575130 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 02:00:22.581496 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:00:22.592422 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:00:22.626876 tst handover.py: using LAC 37767 02:00:22.746668 tst handover.py: using RAC 27 02:00:22.866090 tst handover.py: using CellId 37767 02:00:22.987217 tst handover.py: using BVCI 37768 02:00:23.099888 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:00:23.152504 tst handover.py: using LAC 37768 02:00:23.273477 tst handover.py: using RAC 28 02:00:23.397468 tst handover.py: using CellId 37768 02:00:23.525449 tst handover.py: using BVCI 37769 02:00:23.637533 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:00:23.648417 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:00:23.659237 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:00:23.670120 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:00:23.681510 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:00:23.692615 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:00:23.809377 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:00:23.929538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:00:24.408700 run create_hlr_db(pid=26837): Launched 02:00:24.541828 bus /sierra_2: Setting Powered False 02:00:25.606282 run create_hlr_db(pid=26837): Terminated: ok {rc=0} 02:00:26.018584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26839): Launched 02:00:26.326244 run osmo-hlr_10.42.42.2(pid=26840): Launched 02:00:26.443871 run osmo-stp_10.42.42.5: Starting osmo-stp 02:00:26.944000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26842): Launched 02:00:27.252730 run osmo-stp_10.42.42.5(pid=26843): Launched 02:00:27.370625 run osmo-msc_10.42.42.6: Starting osmo-msc 02:00:27.896618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26845): Launched 02:00:28.203889 run osmo-msc_10.42.42.6(pid=26846): Launched 02:00:28.376317 run osmo-stp_10.42.42.5(pid=26843): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26843)] 02:00:28.505382 run osmo-stp_10.42.42.5(pid=26843): stdout: | (launched: 2022-12-14_02:00:27.195355) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:28.634363 run osmo-stp_10.42.42.5(pid=26843): stderr: | [0;m[38;5;43m20221214020027365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020027366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020027366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020027366 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020027367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020027367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020027367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:28.761618 run osmo-stp_10.42.42.5(pid=26843): stdout: | (launched: 2022-12-14_02:00:27.195355) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:28.882942 run osmo-stp_10.42.42.5(pid=26843): stderr: | [0;m[38;5;43m20221214020027365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020027366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020027366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020027366 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020027367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020027367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020027367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:29.028171 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26843): Process ended prematurely: osmo-stp_10.42.42.5(pid=26843) [trial-2397↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26843)] [trial-2397↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 02:00:29.036906 tst handover.py:18: Test FAILED (6.4 sec) 02:00:29.062787 run osmo-hlr_10.42.42.2(pid=26840): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26840)] 02:00:29.110509 run osmo-hlr_10.42.42.2(pid=26840): stdout: | (launched: 2022-12-14_02:00:26.268413) 02:00:29.159464 run osmo-hlr_10.42.42.2(pid=26840): stderr: | [0;m[1;31m20221214020026446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020026447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020026447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020026447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020026447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020026447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020026459 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020026469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020026470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020026470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:00:29.228037 run osmo-msc_10.42.42.6(pid=26846): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26846)] 02:00:29.274607 run osmo-msc_10.42.42.6(pid=26846): stdout: | (launched: 2022-12-14_02:00:28.146659) 02:00:29.323199 run osmo-msc_10.42.42.6(pid=26846): stderr: | [0;m[38;5;43m20221214020028421 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020028421 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2f52c40c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020028421 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020028421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020028421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020028421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020028423 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020028423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020028424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020028424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:00:29.372191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26839): Terminating (SIGTERM) 02:00:29.411563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26842): Terminating (SIGTERM) 02:00:29.450891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26845): Terminating (SIGTERM) 02:00:29.490655 --- ParallelTerminationStrategy: PID 26839 died... 02:00:29.509894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26839): Terminated: ok {rc=0} 02:00:29.553515 --- ParallelTerminationStrategy: PID 26842 died... 02:00:29.572306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26842): Terminated: ok {rc=0} 02:00:29.615656 --- ParallelTerminationStrategy: PID 26845 died... 02:00:29.634260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26845): Terminated: ok {rc=0} 02:00:29.719317 bus /sierra_3: Setting Powered False 02:00:30.816524 bus /sierra_3: Setting Powered False 02:00:31.929183 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 02:00:33.180675 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:00:33.186050 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:00:33.236165 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:00:33.262546 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:00:33.313566 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:00:33.363581 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:00:33.389751 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:00:33.939642 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 02:00:33.944770 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:00:33.955585 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:00:33.989831 tst handover.py: using LAC 37769 02:00:34.121793 tst handover.py: using RAC 29 02:00:34.246854 tst handover.py: using CellId 37769 02:00:34.375758 tst handover.py: using BVCI 37770 02:00:34.496665 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:00:34.543800 tst handover.py: using LAC 37770 02:00:34.673375 tst handover.py: using RAC 30 02:00:34.799926 tst handover.py: using CellId 37770 02:00:34.927621 tst handover.py: using BVCI 37771 02:00:35.046798 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:00:35.058236 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:00:35.069403 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:00:35.080562 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:00:35.092490 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:00:35.104289 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:00:35.221730 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:00:35.341604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:00:35.820922 run create_hlr_db(pid=26851): Launched 02:00:35.953652 bus /sierra_2: Setting Powered False 02:00:37.017916 run create_hlr_db(pid=26851): Terminated: ok {rc=0} 02:00:37.431010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26853): Launched 02:00:37.740552 run osmo-hlr_10.42.42.2(pid=26854): Launched 02:00:37.858335 run osmo-stp_10.42.42.5: Starting osmo-stp 02:00:38.364626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26856): Launched 02:00:38.671667 run osmo-stp_10.42.42.5(pid=26857): Launched 02:00:38.790392 run osmo-msc_10.42.42.6: Starting osmo-msc 02:00:39.319456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26859): Launched 02:00:39.627193 run osmo-msc_10.42.42.6(pid=26860): Launched 02:00:39.800865 run osmo-stp_10.42.42.5(pid=26857): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26857)] 02:00:39.930231 run osmo-stp_10.42.42.5(pid=26857): stdout: | (launched: 2022-12-14_02:00:38.614595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:40.059185 run osmo-stp_10.42.42.5(pid=26857): stderr: | [0;m[38;5;43m20221214020038784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020038784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020038784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020038785 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020038785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020038785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020038786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:40.186334 run osmo-stp_10.42.42.5(pid=26857): stdout: | (launched: 2022-12-14_02:00:38.614595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:40.308149 run osmo-stp_10.42.42.5(pid=26857): stderr: | [0;m[38;5;43m20221214020038784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020038784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020038784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020038785 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020038785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020038785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020038786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:40.453771 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26857): Process ended prematurely: osmo-stp_10.42.42.5(pid=26857) [trial-2397↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26857)] [trial-2397↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 02:00:40.462170 tst handover.py:18: Test FAILED (6.5 sec) 02:00:40.487857 run osmo-hlr_10.42.42.2(pid=26854): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26854)] 02:00:40.535615 run osmo-hlr_10.42.42.2(pid=26854): stdout: | (launched: 2022-12-14_02:00:37.683158) 02:00:40.584456 run osmo-hlr_10.42.42.2(pid=26854): stderr: | [0;m[1;31m20221214020037858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020037858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020037858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020037858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020037858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020037858 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020037870 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020037878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020037878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020037878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:00:40.652893 run osmo-msc_10.42.42.6(pid=26860): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26860)] 02:00:40.699613 run osmo-msc_10.42.42.6(pid=26860): stdout: | (launched: 2022-12-14_02:00:39.570152) 02:00:40.748244 run osmo-msc_10.42.42.6(pid=26860): stderr: | [0;m[38;5;43m20221214020039841 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020039841 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe92cf56c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020039842 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020039842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020039842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020039842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020039844 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020039844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020039844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020039844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:00:40.797368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26853): Terminating (SIGTERM) 02:00:40.836709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26856): Terminating (SIGTERM) 02:00:40.876153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26859): Terminating (SIGTERM) 02:00:40.915833 --- ParallelTerminationStrategy: PID 26853 died... 02:00:40.935027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26853): Terminated: ok {rc=0} 02:00:40.978803 --- ParallelTerminationStrategy: PID 26856 died... 02:00:40.997523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26856): Terminated: ok {rc=0} 02:00:41.041549 --- ParallelTerminationStrategy: PID 26859 died... 02:00:41.060237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26859): Terminated: ok {rc=0} 02:00:41.144259 bus /sierra_3: Setting Powered False 02:00:42.242898 bus /sierra_3: Setting Powered False 02:00:43.354292 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 02:00:44.613841 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:00:44.619738 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 02:00:44.669465 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 02:00:44.696913 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 02:00:44.751180 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 02:00:44.800281 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 02:00:44.826884 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 02:00:45.376046 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 02:00:45.381596 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 02:00:45.392539 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 02:00:45.427330 tst handover.py: using LAC 37771 02:00:45.555475 tst handover.py: using RAC 31 02:00:45.684007 tst handover.py: using CellId 37771 02:00:45.812545 tst handover.py: using BVCI 37772 02:00:45.950044 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 02:00:46.003609 tst handover.py: using LAC 37772 02:00:46.136892 tst handover.py: using RAC 32 02:00:46.269044 tst handover.py: using CellId 37772 02:00:46.402717 tst handover.py: using BVCI 37773 02:00:46.525465 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 02:00:46.537357 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 02:00:46.548908 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 02:00:46.560562 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 02:00:46.572438 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 02:00:46.584451 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 02:00:46.720686 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 02:00:46.869537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:00:47.371590 run create_hlr_db(pid=26865): Launched 02:00:47.501227 bus /sierra_2: Setting Powered False 02:00:48.566180 run create_hlr_db(pid=26865): Terminated: ok {rc=0} 02:00:48.978558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26867): Launched 02:00:49.286965 run osmo-hlr_10.42.42.2(pid=26868): Launched 02:00:49.404389 run osmo-stp_10.42.42.5: Starting osmo-stp 02:00:49.919839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26870): Launched 02:00:50.226630 run osmo-stp_10.42.42.5(pid=26871): Launched 02:00:50.343868 run osmo-msc_10.42.42.6: Starting osmo-msc 02:00:50.874392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26873): Launched 02:00:51.183502 run osmo-msc_10.42.42.6(pid=26874): Launched 02:00:51.356792 run osmo-stp_10.42.42.5(pid=26871): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26871)] 02:00:51.486231 run osmo-stp_10.42.42.5(pid=26871): stdout: | (launched: 2022-12-14_02:00:50.169447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:51.615544 run osmo-stp_10.42.42.5(pid=26871): stderr: | [0;m[38;5;43m20221214020050340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020050340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020050340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020050340 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020050341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020050341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020050341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:51.742767 run osmo-stp_10.42.42.5(pid=26871): stdout: | (launched: 2022-12-14_02:00:50.169447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:00:51.865363 run osmo-stp_10.42.42.5(pid=26871): stderr: | [0;m[38;5;43m20221214020050340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020050340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020050340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020050340 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020050341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020050341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020050341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:00:52.014360 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26871): Process ended prematurely: osmo-stp_10.42.42.5(pid=26871) [trial-2397↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26871)] [trial-2397↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 02:00:52.022657 tst handover.py:18: Test FAILED (6.6 sec) 02:00:52.048321 run osmo-hlr_10.42.42.2(pid=26868): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26868)] 02:00:52.095817 run osmo-hlr_10.42.42.2(pid=26868): stdout: | (launched: 2022-12-14_02:00:49.228767) 02:00:52.144629 run osmo-hlr_10.42.42.2(pid=26868): stderr: | [0;m[1;31m20221214020049404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020049404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020049404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020049404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020049404 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020049405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020049416 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020049424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020049424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020049425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:00:52.213364 run osmo-msc_10.42.42.6(pid=26874): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26874)] 02:00:52.260062 run osmo-msc_10.42.42.6(pid=26874): stdout: | (launched: 2022-12-14_02:00:51.126382) 02:00:52.308748 run osmo-msc_10.42.42.6(pid=26874): stderr: | [0;m[38;5;43m20221214020051398 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020051398 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3592913c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020051399 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020051399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020051399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020051399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020051401 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020051401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020051401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020051401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:00:52.357768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26867): Terminating (SIGTERM) 02:00:52.397226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26870): Terminating (SIGTERM) 02:00:52.436812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26873): Terminating (SIGTERM) 02:00:52.476532 --- ParallelTerminationStrategy: PID 26867 died... 02:00:52.495868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26867): Terminated: ok {rc=0} 02:00:52.539529 --- ParallelTerminationStrategy: PID 26870 died... 02:00:52.558240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26870): Terminated: ok {rc=0} 02:00:52.601675 --- ParallelTerminationStrategy: PID 26873 died... 02:00:52.620600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26873): Terminated: ok {rc=0} 02:00:52.706671 bus /sierra_3: Setting Powered False 02:00:53.806724 bus /sierra_3: Setting Powered False 02:00:54.920495 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 02:00:56.177090 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:00:56.182581 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 02:00:56.227769 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 02:00:56.254190 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 02:00:56.306733 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 02:00:56.351622 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 02:00:56.377771 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 02:00:56.929534 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 02:00:56.935232 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:00:56.946359 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 02:00:56.979800 tst handover.py: using LAC 37773 02:00:57.110134 tst handover.py: using RAC 33 02:00:57.238216 tst handover.py: using CellId 37773 02:00:57.369504 tst handover.py: using BVCI 37774 02:00:57.490396 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 02:00:57.536504 tst handover.py: using LAC 37774 02:00:57.658984 tst handover.py: using RAC 34 02:00:57.780038 tst handover.py: using CellId 37774 02:00:57.911553 tst handover.py: using BVCI 37775 02:00:58.032220 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:00:58.043997 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:00:58.055286 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:00:58.066812 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:00:58.078403 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:00:58.089822 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 02:00:58.207090 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 02:00:58.321441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:00:58.770017 run create_hlr_db(pid=26883): Launched 02:00:58.891200 bus /sierra_2: Setting Powered False 02:00:59.952483 run create_hlr_db(pid=26883): Terminated: ok {rc=0} 02:01:00.374922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26885): Launched 02:01:00.705075 run osmo-hlr_10.42.42.2(pid=26886): Launched 02:01:00.843407 run osmo-stp_10.42.42.5: Starting osmo-stp 02:01:01.466341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26888): Launched 02:01:01.834324 run osmo-stp_10.42.42.5(pid=26889): Launched 02:01:02.095754 run osmo-msc_10.42.42.6: Starting osmo-msc 02:01:02.808234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26891): Launched 02:01:03.138596 run osmo-msc_10.42.42.6(pid=26892): Launched 02:01:03.323539 run osmo-stp_10.42.42.5(pid=26889): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26889)] 02:01:03.460401 run osmo-stp_10.42.42.5(pid=26889): stdout: | (launched: 2022-12-14_02:01:01.754889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:03.598155 run osmo-stp_10.42.42.5(pid=26889): stderr: | [0;m[38;5;43m20221214020102100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020102100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020102100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020102100 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020102101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020102101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020102101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:03.734313 run osmo-stp_10.42.42.5(pid=26889): stdout: | (launched: 2022-12-14_02:01:01.754889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:03.864848 run osmo-stp_10.42.42.5(pid=26889): stderr: | [0;m[38;5;43m20221214020102100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020102100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020102100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020102100 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020102101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020102101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020102101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:04.021205 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26889): Process ended prematurely: osmo-stp_10.42.42.5(pid=26889) [trial-2397↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26889)] [trial-2397↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 02:01:04.030332 tst handover.py:18: Test FAILED (7.1 sec) 02:01:04.057729 run osmo-hlr_10.42.42.2(pid=26886): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26886)] 02:01:04.107209 run osmo-hlr_10.42.42.2(pid=26886): stdout: | (launched: 2022-12-14_02:01:00.644471) 02:01:04.158235 run osmo-hlr_10.42.42.2(pid=26886): stderr: | [0;m[1;31m20221214020100845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020100845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020100845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020100845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020100845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020100845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020100871 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020100879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020100879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020100879 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:01:04.229149 run osmo-msc_10.42.42.6(pid=26892): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26892)] 02:01:04.278306 run osmo-msc_10.42.42.6(pid=26892): stdout: | (launched: 2022-12-14_02:01:03.077865) 02:01:04.329613 run osmo-msc_10.42.42.6(pid=26892): stderr: | [0;m[38;5;43m20221214020103399 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020103399 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc263dc7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020103399 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020103399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020103400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020103400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020103402 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020103402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020103402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020103402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:01:04.380835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26885): Terminating (SIGTERM) 02:01:04.422025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26888): Terminating (SIGTERM) 02:01:04.463445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26891): Terminating (SIGTERM) 02:01:04.504879 --- ParallelTerminationStrategy: PID 26885 died... 02:01:04.524813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26885): Terminated: ok {rc=0} 02:01:04.570396 --- ParallelTerminationStrategy: PID 26888 died... 02:01:04.589801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26888): Terminated: ok {rc=0} 02:01:04.635244 --- ParallelTerminationStrategy: PID 26891 died... 02:01:04.654653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26891): Terminated: ok {rc=0} 02:01:04.742017 bus /sierra_3: Setting Powered False 02:01:05.840011 bus /sierra_3: Setting Powered False 02:01:06.958743 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 02:01:08.208713 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:01:08.214875 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 02:01:08.264656 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 02:01:08.291042 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 02:01:08.343373 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 02:01:08.396006 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 02:01:08.423388 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 02:01:08.969512 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 02:01:08.974626 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:01:08.985636 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 02:01:09.018192 tst handover.py: using LAC 37775 02:01:09.147269 tst handover.py: using RAC 35 02:01:09.277822 tst handover.py: using CellId 37775 02:01:09.406605 tst handover.py: using BVCI 37776 02:01:09.527332 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 02:01:09.577010 tst handover.py: using LAC 37776 02:01:09.702918 tst handover.py: using RAC 36 02:01:09.831399 tst handover.py: using CellId 37776 02:01:09.957329 tst handover.py: using BVCI 37777 02:01:10.078239 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:01:10.089708 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:01:10.100863 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:01:10.112196 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:01:10.123434 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:01:10.134704 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:01:10.251640 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:01:10.371657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:01:10.851379 run create_hlr_db(pid=26897): Launched 02:01:10.983008 bus /sierra_2: Setting Powered False 02:01:12.047567 run create_hlr_db(pid=26897): Terminated: ok {rc=0} 02:01:12.477612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26899): Launched 02:01:12.807813 run osmo-hlr_10.42.42.2(pid=26900): Launched 02:01:12.934409 run osmo-stp_10.42.42.5: Starting osmo-stp 02:01:13.476017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26902): Launched 02:01:13.806289 run osmo-stp_10.42.42.5(pid=26903): Launched 02:01:13.932260 run osmo-msc_10.42.42.6: Starting osmo-msc 02:01:14.495236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26905): Launched 02:01:14.825765 run osmo-msc_10.42.42.6(pid=26906): Launched 02:01:15.009403 run osmo-stp_10.42.42.5(pid=26903): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26903)] 02:01:15.151479 run osmo-stp_10.42.42.5(pid=26903): stdout: | (launched: 2022-12-14_02:01:13.745799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:15.293291 run osmo-stp_10.42.42.5(pid=26903): stderr: | [0;m[38;5;43m20221214020113937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020113937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020113938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020113938 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020113939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020113939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020113939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:15.435445 run osmo-stp_10.42.42.5(pid=26903): stdout: | (launched: 2022-12-14_02:01:13.745799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:15.566024 run osmo-stp_10.42.42.5(pid=26903): stderr: | [0;m[38;5;43m20221214020113937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020113937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020113938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020113938 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020113939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020113939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020113939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:15.721856 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26903): Process ended prematurely: osmo-stp_10.42.42.5(pid=26903) [trial-2397↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26903)] [trial-2397↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 02:01:15.731090 tst handover.py:18: Test FAILED (6.7 sec) 02:01:15.758506 run osmo-hlr_10.42.42.2(pid=26900): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26900)] 02:01:15.808013 run osmo-hlr_10.42.42.2(pid=26900): stdout: | (launched: 2022-12-14_02:01:12.747039) 02:01:15.873841 run osmo-hlr_10.42.42.2(pid=26900): stderr: | [0;m[1;31m20221214020112946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020112946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020112947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020112947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020112947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020112947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020112962 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020112970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020112971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020112971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:01:15.956353 run osmo-msc_10.42.42.6(pid=26906): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26906)] 02:01:16.007107 run osmo-msc_10.42.42.6(pid=26906): stdout: | (launched: 2022-12-14_02:01:14.765040) 02:01:16.059292 run osmo-msc_10.42.42.6(pid=26906): stderr: | [0;m[38;5;43m20221214020115088 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020115088 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1497c51c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020115088 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020115088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020115089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020115089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020115090 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020115091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020115091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020115091 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:01:16.112182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26899): Terminating (SIGTERM) 02:01:16.154794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26902): Terminating (SIGTERM) 02:01:16.199354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26905): Terminating (SIGTERM) 02:01:16.243555 --- ParallelTerminationStrategy: PID 26899 died... 02:01:16.264552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26899): Terminated: ok {rc=0} 02:01:16.311529 --- ParallelTerminationStrategy: PID 26902 died... 02:01:16.331710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26902): Terminated: ok {rc=0} 02:01:16.378985 --- ParallelTerminationStrategy: PID 26905 died... 02:01:16.399149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26905): Terminated: ok {rc=0} 02:01:16.488396 bus /sierra_3: Setting Powered False 02:01:17.583917 bus /sierra_3: Setting Powered False 02:01:18.696829 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 02:01:19.954028 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:01:19.959106 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 02:01:19.996005 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 02:01:20.022586 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 02:01:20.075826 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 02:01:20.113234 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 02:01:20.139786 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 02:01:20.691299 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 02:01:20.696733 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:01:20.708004 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 02:01:20.743901 tst handover.py: using LAC 37777 02:01:20.872205 tst handover.py: using RAC 37 02:01:21.001077 tst handover.py: using CellId 37777 02:01:21.127416 tst handover.py: using BVCI 37778 02:01:21.246704 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 02:01:21.281161 tst handover.py: using LAC 37778 02:01:21.408174 tst handover.py: using RAC 38 02:01:21.537364 tst handover.py: using CellId 37778 02:01:21.663715 tst handover.py: using BVCI 37779 02:01:21.775952 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:01:21.786747 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:01:21.797395 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:01:21.807963 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:01:21.818950 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:01:21.829846 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 02:01:21.973837 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 02:01:22.089762 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:01:22.538917 run create_hlr_db(pid=26911): Launched 02:01:22.657474 bus /sierra_2: Setting Powered False 02:01:23.718116 run create_hlr_db(pid=26911): Terminated: ok {rc=0} 02:01:24.120243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26913): Launched 02:01:24.427460 run osmo-hlr_10.42.42.2(pid=26914): Launched 02:01:24.546315 run osmo-stp_10.42.42.5: Starting osmo-stp 02:01:25.063014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26916): Launched 02:01:25.369926 run osmo-stp_10.42.42.5(pid=26917): Launched 02:01:25.488482 run osmo-msc_10.42.42.6: Starting osmo-msc 02:01:26.015652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26919): Launched 02:01:26.323303 run osmo-msc_10.42.42.6(pid=26920): Launched 02:01:26.496428 run osmo-stp_10.42.42.5(pid=26917): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26917)] 02:01:26.626115 run osmo-stp_10.42.42.5(pid=26917): stdout: | (launched: 2022-12-14_02:01:25.312623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:26.755459 run osmo-stp_10.42.42.5(pid=26917): stderr: | [0;m[38;5;43m20221214020125487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020125487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020125487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020125488 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020125488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020125488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020125488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:26.882448 run osmo-stp_10.42.42.5(pid=26917): stdout: | (launched: 2022-12-14_02:01:25.312623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:27.004067 run osmo-stp_10.42.42.5(pid=26917): stderr: | [0;m[38;5;43m20221214020125487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020125487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020125487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020125488 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020125488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020125488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020125488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:27.149655 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26917): Process ended prematurely: osmo-stp_10.42.42.5(pid=26917) [trial-2397↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26917)] [trial-2397↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 02:01:27.157926 tst handover.py:18: Test FAILED (6.5 sec) 02:01:27.183839 run osmo-hlr_10.42.42.2(pid=26914): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26914)] 02:01:27.232035 run osmo-hlr_10.42.42.2(pid=26914): stdout: | (launched: 2022-12-14_02:01:24.370172) 02:01:27.281549 run osmo-hlr_10.42.42.2(pid=26914): stderr: | [0;m[1;31m20221214020124548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020124548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020124548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020124548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020124548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020124548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020124560 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020124568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020124568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020124568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:01:27.350606 run osmo-msc_10.42.42.6(pid=26920): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26920)] 02:01:27.397868 run osmo-msc_10.42.42.6(pid=26920): stdout: | (launched: 2022-12-14_02:01:26.266212) 02:01:27.447101 run osmo-msc_10.42.42.6(pid=26920): stderr: | [0;m[38;5;43m20221214020126537 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020126537 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2bead3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020126537 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020126537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020126538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020126538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020126539 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020126540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020126540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020126540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:01:27.497308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26913): Terminating (SIGTERM) 02:01:27.537917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26916): Terminating (SIGTERM) 02:01:27.577661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26919): Terminating (SIGTERM) 02:01:27.617681 --- ParallelTerminationStrategy: PID 26913 died... 02:01:27.637320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26913): Terminated: ok {rc=0} 02:01:27.681373 --- ParallelTerminationStrategy: PID 26916 died... 02:01:27.700261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26916): Terminated: ok {rc=0} 02:01:27.744021 --- ParallelTerminationStrategy: PID 26919 died... 02:01:27.763167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26919): Terminated: ok {rc=0} 02:01:27.848729 bus /sierra_3: Setting Powered False 02:01:28.947733 bus /sierra_3: Setting Powered False 02:01:30.063540 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 02:01:31.328014 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:01:31.333754 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 02:01:31.388043 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 02:01:31.415716 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 02:01:31.468894 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 02:01:31.532784 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 02:01:31.566355 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 02:01:32.098265 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 02:01:32.104570 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:01:32.116583 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:01:32.152042 tst handover.py: using LAC 37779 02:01:32.293784 tst handover.py: using RAC 39 02:01:32.421821 tst handover.py: using CellId 37779 02:01:32.549875 tst handover.py: using BVCI 37780 02:01:32.668458 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:01:32.719127 tst handover.py: using LAC 37780 02:01:32.848357 tst handover.py: using RAC 40 02:01:32.980626 tst handover.py: using CellId 37780 02:01:33.101686 tst handover.py: using BVCI 37781 02:01:33.214994 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:01:33.226060 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:01:33.236876 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:01:33.247840 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:01:33.259204 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:01:33.270365 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:01:33.392327 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:01:33.508750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:01:33.958359 run create_hlr_db(pid=26925): Launched 02:01:34.075111 bus /sierra_2: Setting Powered False 02:01:35.136041 run create_hlr_db(pid=26925): Terminated: ok {rc=0} 02:01:35.556565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26927): Launched 02:01:35.885376 run osmo-hlr_10.42.42.2(pid=26928): Launched 02:01:36.012559 run osmo-stp_10.42.42.5: Starting osmo-stp 02:01:36.550365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26930): Launched 02:01:36.877604 run osmo-stp_10.42.42.5(pid=26931): Launched 02:01:37.003233 run osmo-msc_10.42.42.6: Starting osmo-msc 02:01:37.568835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26933): Launched 02:01:37.897944 run osmo-msc_10.42.42.6(pid=26934): Launched 02:01:38.080348 run osmo-stp_10.42.42.5(pid=26931): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26931)] 02:01:38.217900 run osmo-stp_10.42.42.5(pid=26931): stdout: | (launched: 2022-12-14_02:01:36.817240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:38.356215 run osmo-stp_10.42.42.5(pid=26931): stderr: | [0;m[38;5;43m20221214020137009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020137009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020137010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020137010 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020137011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020137012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020137012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:38.493298 run osmo-stp_10.42.42.5(pid=26931): stdout: | (launched: 2022-12-14_02:01:36.817240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:38.623445 run osmo-stp_10.42.42.5(pid=26931): stderr: | [0;m[38;5;43m20221214020137009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020137009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020137010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020137010 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020137011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020137012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020137012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:38.779475 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26931): Process ended prematurely: osmo-stp_10.42.42.5(pid=26931) [trial-2397↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26931)] [trial-2397↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 02:01:38.788264 tst handover.py:18: Test FAILED (6.7 sec) 02:01:38.815691 run osmo-hlr_10.42.42.2(pid=26928): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26928)] 02:01:38.865513 run osmo-hlr_10.42.42.2(pid=26928): stdout: | (launched: 2022-12-14_02:01:35.824683) 02:01:38.917250 run osmo-hlr_10.42.42.2(pid=26928): stderr: | [0;m[1;31m20221214020136024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020136024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020136024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020136024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020136024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020136024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020136040 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020136048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020136048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020136048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:01:38.989185 run osmo-msc_10.42.42.6(pid=26934): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26934)] 02:01:39.039073 run osmo-msc_10.42.42.6(pid=26934): stdout: | (launched: 2022-12-14_02:01:37.837413) 02:01:39.090624 run osmo-msc_10.42.42.6(pid=26934): stderr: | [0;m[38;5;43m20221214020138159 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020138159 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efe1cef6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020138159 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020138159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020138160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020138160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020138161 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020138162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020138162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020138162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:01:39.142390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26927): Terminating (SIGTERM) 02:01:39.183688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26930): Terminating (SIGTERM) 02:01:39.225146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26933): Terminating (SIGTERM) 02:01:39.267047 --- ParallelTerminationStrategy: PID 26927 died... 02:01:39.286958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26927): Terminated: ok {rc=0} 02:01:39.333580 --- ParallelTerminationStrategy: PID 26930 died... 02:01:39.353140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26930): Terminated: ok {rc=0} 02:01:39.398984 --- ParallelTerminationStrategy: PID 26933 died... 02:01:39.418501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26933): Terminated: ok {rc=0} 02:01:39.506229 bus /sierra_3: Setting Powered False 02:01:40.604142 bus /sierra_3: Setting Powered False 02:01:41.721744 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 02:01:42.975082 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:01:42.980377 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:01:43.029509 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:01:43.055859 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:01:43.108148 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:01:43.159102 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:01:43.186463 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:01:43.733399 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 02:01:43.739289 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:01:43.750577 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:01:43.784155 tst handover.py: using LAC 37781 02:01:43.905358 tst handover.py: using RAC 41 02:01:44.025362 tst handover.py: using CellId 37781 02:01:44.147542 tst handover.py: using BVCI 37782 02:01:44.260132 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:01:44.308265 tst handover.py: using LAC 37782 02:01:44.430624 tst handover.py: using RAC 42 02:01:44.553432 tst handover.py: using CellId 37782 02:01:44.683816 tst handover.py: using BVCI 37783 02:01:44.797279 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:01:44.808065 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:01:44.819103 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:01:44.829939 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:01:44.841221 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:01:44.852143 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:01:44.973734 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:01:45.097570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:01:45.578416 run create_hlr_db(pid=26939): Launched 02:01:45.713616 bus /sierra_2: Setting Powered False 02:01:46.776188 run create_hlr_db(pid=26939): Terminated: ok {rc=0} 02:01:47.197768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26941): Launched 02:01:47.530621 run osmo-hlr_10.42.42.2(pid=26942): Launched 02:01:47.656136 run osmo-stp_10.42.42.5: Starting osmo-stp 02:01:48.194227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26944): Launched 02:01:48.523046 run osmo-stp_10.42.42.5(pid=26945): Launched 02:01:48.650637 run osmo-msc_10.42.42.6: Starting osmo-msc 02:01:49.216600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26947): Launched 02:01:49.546562 run osmo-msc_10.42.42.6(pid=26948): Launched 02:01:49.732418 run osmo-stp_10.42.42.5(pid=26945): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26945)] 02:01:49.870559 run osmo-stp_10.42.42.5(pid=26945): stdout: | (launched: 2022-12-14_02:01:48.462370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:50.008555 run osmo-stp_10.42.42.5(pid=26945): stderr: | [0;m[38;5;43m20221214020148656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020148656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020148656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020148657 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020148657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020148657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020148657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:50.145182 run osmo-stp_10.42.42.5(pid=26945): stdout: | (launched: 2022-12-14_02:01:48.462370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:01:50.275583 run osmo-stp_10.42.42.5(pid=26945): stderr: | [0;m[38;5;43m20221214020148656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020148656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020148656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020148657 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020148657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020148657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020148657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:01:50.432445 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26945): Process ended prematurely: osmo-stp_10.42.42.5(pid=26945) [trial-2397↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26945)] [trial-2397↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 02:01:50.441574 tst handover.py:18: Test FAILED (6.7 sec) 02:01:50.468615 run osmo-hlr_10.42.42.2(pid=26942): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26942)] 02:01:50.518283 run osmo-hlr_10.42.42.2(pid=26942): stdout: | (launched: 2022-12-14_02:01:47.469484) 02:01:50.569539 run osmo-hlr_10.42.42.2(pid=26942): stderr: | [0;m[1;31m20221214020147670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020147670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020147670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020147670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020147670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020147670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020147684 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020147693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020147694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020147694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:01:50.641092 run osmo-msc_10.42.42.6(pid=26948): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26948)] 02:01:50.690693 run osmo-msc_10.42.42.6(pid=26948): stdout: | (launched: 2022-12-14_02:01:49.485338) 02:01:50.742052 run osmo-msc_10.42.42.6(pid=26948): stderr: | [0;m[38;5;43m20221214020149808 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020149808 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fca99d63c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020149809 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020149809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020149809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020149809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020149812 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020149812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020149812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020149812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:01:50.793476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26941): Terminating (SIGTERM) 02:01:50.835012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26944): Terminating (SIGTERM) 02:01:50.877017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26947): Terminating (SIGTERM) 02:01:50.919169 --- ParallelTerminationStrategy: PID 26941 died... 02:01:50.939093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26941): Terminated: ok {rc=0} 02:01:50.984886 --- ParallelTerminationStrategy: PID 26944 died... 02:01:51.004472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26944): Terminated: ok {rc=0} 02:01:51.049795 --- ParallelTerminationStrategy: PID 26947 died... 02:01:51.069193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26947): Terminated: ok {rc=0} 02:01:51.156410 bus /sierra_3: Setting Powered False 02:01:52.256013 bus /sierra_3: Setting Powered False 02:01:53.373798 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 02:01:54.629369 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:01:54.634912 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 02:01:54.694878 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 02:01:54.721293 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 02:01:54.772941 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 02:01:54.831771 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 02:01:54.857931 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 02:01:55.410687 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 02:01:55.416503 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:01:55.427585 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 02:01:55.475286 tst handover.py: using LAC 37783 02:01:55.595047 tst handover.py: using RAC 43 02:01:55.716567 tst handover.py: using CellId 37783 02:01:55.836717 tst handover.py: using BVCI 37784 02:01:55.947580 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 02:01:55.991744 tst handover.py: using LAC 37784 02:01:56.113110 tst handover.py: using RAC 44 02:01:56.235511 tst handover.py: using CellId 37784 02:01:56.356296 tst handover.py: using BVCI 37785 02:01:56.467301 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:01:56.478436 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:01:56.489387 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:01:56.500246 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:01:56.511543 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 02:01:56.522707 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 02:01:56.643294 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 02:01:56.759499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:01:57.209790 run create_hlr_db(pid=26954): Launched 02:01:57.328049 bus /sierra_2: Setting Powered False 02:01:58.389462 run create_hlr_db(pid=26954): Terminated: ok {rc=0} 02:01:58.792320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26956): Launched 02:01:59.099245 run osmo-hlr_10.42.42.2(pid=26957): Launched 02:01:59.216013 run osmo-stp_10.42.42.5: Starting osmo-stp 02:01:59.734124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26959): Launched 02:02:00.042702 run osmo-stp_10.42.42.5(pid=26960): Launched 02:02:00.163038 run osmo-msc_10.42.42.6: Starting osmo-msc 02:02:00.692089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26962): Launched 02:02:01.030803 run osmo-msc_10.42.42.6(pid=26963): Launched 02:02:01.413786 run osmo-stp_10.42.42.5(pid=26960): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26960)] 02:02:01.730010 run osmo-stp_10.42.42.5(pid=26960): stdout: | (launched: 2022-12-14_02:01:59.985668) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:01.905097 run osmo-stp_10.42.42.5(pid=26960): stderr: | [0;m[38;5;43m20221214020200155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020200155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020200155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020200156 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020200156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020200157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020200157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:02.036599 run osmo-stp_10.42.42.5(pid=26960): stdout: | (launched: 2022-12-14_02:01:59.985668) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:02.162648 run osmo-stp_10.42.42.5(pid=26960): stderr: | [0;m[38;5;43m20221214020200155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020200155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020200155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020200156 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020200156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020200157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020200157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:02.312548 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26960): Process ended prematurely: osmo-stp_10.42.42.5(pid=26960) [trial-2397↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26960)] [trial-2397↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 02:02:02.320999 tst handover.py:18: Test FAILED (6.9 sec) 02:02:02.347096 run osmo-hlr_10.42.42.2(pid=26957): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26957)] 02:02:02.395168 run osmo-hlr_10.42.42.2(pid=26957): stdout: | (launched: 2022-12-14_02:01:59.042222) 02:02:02.444549 run osmo-hlr_10.42.42.2(pid=26957): stderr: | [0;m[1;31m20221214020159219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020159219 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020159220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020159220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020159220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020159220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020159232 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020159240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020159240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020159240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:02:02.514104 run osmo-msc_10.42.42.6(pid=26963): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26963)] 02:02:02.562098 run osmo-msc_10.42.42.6(pid=26963): stdout: | (launched: 2022-12-14_02:02:00.967169) 02:02:02.611395 run osmo-msc_10.42.42.6(pid=26963): stderr: | [0;m[38;5;43m20221214020201445 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020201445 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f44b5551c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020201446 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020201446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020201446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020201446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020201448 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020201448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020201448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020201448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:02:02.661203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26956): Terminating (SIGTERM) 02:02:02.701247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26959): Terminating (SIGTERM) 02:02:02.741248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26962): Terminating (SIGTERM) 02:02:02.781508 --- ParallelTerminationStrategy: PID 26956 died... 02:02:02.801092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26956): Terminated: ok {rc=0} 02:02:02.845794 --- ParallelTerminationStrategy: PID 26959 died... 02:02:02.864831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26959): Terminated: ok {rc=0} 02:02:02.909197 --- ParallelTerminationStrategy: PID 26962 died... 02:02:02.928507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26962): Terminated: ok {rc=0} 02:02:03.015806 bus /sierra_3: Setting Powered False 02:02:04.114607 bus /sierra_3: Setting Powered False 02:02:05.231245 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 02:02:06.498499 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:02:06.503645 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 02:02:06.566629 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 02:02:06.593398 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 02:02:06.646286 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 02:02:06.712521 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 02:02:06.740115 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 02:02:07.286650 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 02:02:07.292614 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:07.304085 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 02:02:07.352646 tst handover.py: using LAC 37785 02:02:07.472932 tst handover.py: using RAC 45 02:02:07.593984 tst handover.py: using CellId 37785 02:02:07.714330 tst handover.py: using BVCI 37786 02:02:07.827753 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 02:02:07.877425 tst handover.py: using LAC 37786 02:02:07.998607 tst handover.py: using RAC 46 02:02:08.121133 tst handover.py: using CellId 37786 02:02:08.242669 tst handover.py: using BVCI 37787 02:02:08.355716 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:08.366787 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:08.377802 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:08.388577 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:08.400216 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:08.411898 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:02:08.535152 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:02:08.654051 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:02:09.102624 run create_hlr_db(pid=26969): Launched 02:02:09.220896 bus /sierra_2: Setting Powered False 02:02:10.281681 run create_hlr_db(pid=26969): Terminated: ok {rc=0} 02:02:10.684336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26971): Launched 02:02:10.991865 run osmo-hlr_10.42.42.2(pid=26972): Launched 02:02:11.108510 run osmo-stp_10.42.42.5: Starting osmo-stp 02:02:11.612269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26974): Launched 02:02:11.944585 run osmo-stp_10.42.42.5(pid=26975): Launched 02:02:12.071520 run osmo-msc_10.42.42.6: Starting osmo-msc 02:02:12.637190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26977): Launched 02:02:12.967478 run osmo-msc_10.42.42.6(pid=26978): Launched 02:02:13.151911 run osmo-stp_10.42.42.5(pid=26975): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26975)] 02:02:13.289911 run osmo-stp_10.42.42.5(pid=26975): stdout: | (launched: 2022-12-14_02:02:11.882604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:13.428471 run osmo-stp_10.42.42.5(pid=26975): stderr: | [0;m[38;5;43m20221214020212076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020212077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020212077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020212077 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020212078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020212078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020212078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:13.565503 run osmo-stp_10.42.42.5(pid=26975): stdout: | (launched: 2022-12-14_02:02:11.882604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:13.696033 run osmo-stp_10.42.42.5(pid=26975): stderr: | [0;m[38;5;43m20221214020212076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020212077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020212077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020212077 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020212078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020212078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020212078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:13.852614 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26975): Process ended prematurely: osmo-stp_10.42.42.5(pid=26975) [trial-2397↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26975)] [trial-2397↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 02:02:13.861718 tst handover.py:18: Test FAILED (6.6 sec) 02:02:13.889528 run osmo-hlr_10.42.42.2(pid=26972): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26972)] 02:02:13.939473 run osmo-hlr_10.42.42.2(pid=26972): stdout: | (launched: 2022-12-14_02:02:10.934312) 02:02:13.991240 run osmo-hlr_10.42.42.2(pid=26972): stderr: | [0;m[1;31m20221214020211112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020211112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020211112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020211112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020211112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020211112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020211124 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020211133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020211133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020211133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:02:14.063484 run osmo-msc_10.42.42.6(pid=26978): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26978)] 02:02:14.113507 run osmo-msc_10.42.42.6(pid=26978): stdout: | (launched: 2022-12-14_02:02:12.906659) 02:02:14.165287 run osmo-msc_10.42.42.6(pid=26978): stderr: | [0;m[38;5;43m20221214020213229 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020213229 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7136181c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020213229 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020213229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020213230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020213230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020213231 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020213232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020213232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020213232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:02:14.217317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26971): Terminating (SIGTERM) 02:02:14.258896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26974): Terminating (SIGTERM) 02:02:14.301162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26977): Terminating (SIGTERM) 02:02:14.343434 --- ParallelTerminationStrategy: PID 26971 died... 02:02:14.363451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26971): Terminated: ok {rc=0} 02:02:14.409859 --- ParallelTerminationStrategy: PID 26974 died... 02:02:14.429430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26974): Terminated: ok {rc=0} 02:02:14.475408 --- ParallelTerminationStrategy: PID 26977 died... 02:02:14.495050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26977): Terminated: ok {rc=0} 02:02:14.582834 bus /sierra_3: Setting Powered False 02:02:15.680726 bus /sierra_3: Setting Powered False 02:02:16.792361 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 02:02:18.066501 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:02:18.071893 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 02:02:18.122643 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 02:02:18.148996 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 02:02:18.200488 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 02:02:18.250886 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 02:02:18.276992 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 02:02:18.826879 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 02:02:18.832126 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:02:18.842975 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 02:02:18.890266 tst handover.py: using LAC 37787 02:02:19.011913 tst handover.py: using RAC 47 02:02:19.132916 tst handover.py: using CellId 37787 02:02:19.253119 tst handover.py: using BVCI 37788 02:02:19.364252 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 02:02:19.399603 tst handover.py: using LAC 37788 02:02:19.528316 tst handover.py: using RAC 48 02:02:19.656443 tst handover.py: using CellId 37788 02:02:19.784729 tst handover.py: using BVCI 37789 02:02:19.904077 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:02:19.915620 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:02:19.926934 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:02:19.938359 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:02:19.949672 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:02:19.960686 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 02:02:20.077674 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 02:02:20.198062 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:02:20.680169 run create_hlr_db(pid=26983): Launched 02:02:20.814377 bus /sierra_2: Setting Powered False 02:02:21.879315 run create_hlr_db(pid=26983): Terminated: ok {rc=0} 02:02:22.294309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26985): Launched 02:02:22.604297 run osmo-hlr_10.42.42.2(pid=26986): Launched 02:02:22.721733 run osmo-stp_10.42.42.5: Starting osmo-stp 02:02:23.237995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26988): Launched 02:02:23.546553 run osmo-stp_10.42.42.5(pid=26989): Launched 02:02:23.665199 run osmo-msc_10.42.42.6: Starting osmo-msc 02:02:24.194006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26991): Launched 02:02:24.501485 run osmo-msc_10.42.42.6(pid=26992): Launched 02:02:24.674864 run osmo-stp_10.42.42.5(pid=26989): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26989)] 02:02:24.804446 run osmo-stp_10.42.42.5(pid=26989): stdout: | (launched: 2022-12-14_02:02:23.489274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:24.935008 run osmo-stp_10.42.42.5(pid=26989): stderr: | [0;m[38;5;43m20221214020223663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020223663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020223663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020223664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020223664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020223664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020223664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:25.062720 run osmo-stp_10.42.42.5(pid=26989): stdout: | (launched: 2022-12-14_02:02:23.489274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:25.185213 run osmo-stp_10.42.42.5(pid=26989): stderr: | [0;m[38;5;43m20221214020223663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020223663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020223663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020223664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020223664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020223664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020223664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:25.331582 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=26989): Process ended prematurely: osmo-stp_10.42.42.5(pid=26989) [trial-2397↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26989)] [trial-2397↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 02:02:25.339889 tst handover.py:18: Test FAILED (6.5 sec) 02:02:25.366044 run osmo-hlr_10.42.42.2(pid=26986): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26986)] 02:02:25.414458 run osmo-hlr_10.42.42.2(pid=26986): stdout: | (launched: 2022-12-14_02:02:22.546530) 02:02:25.463709 run osmo-hlr_10.42.42.2(pid=26986): stderr: | [0;m[1;31m20221214020222723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020222723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020222723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020222723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020222723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020222723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020222735 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020222743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020222743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020222743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:02:25.533050 run osmo-msc_10.42.42.6(pid=26992): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26992)] 02:02:25.580190 run osmo-msc_10.42.42.6(pid=26992): stdout: | (launched: 2022-12-14_02:02:24.444354) 02:02:25.629420 run osmo-msc_10.42.42.6(pid=26992): stderr: | [0;m[38;5;43m20221214020224717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020224717 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f75adda6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020224717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020224717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020224717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020224717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020224719 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020224719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020224720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020224720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:02:25.679052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26985): Terminating (SIGTERM) 02:02:25.718626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26988): Terminating (SIGTERM) 02:02:25.758315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26991): Terminating (SIGTERM) 02:02:25.798381 --- ParallelTerminationStrategy: PID 26985 died... 02:02:25.818053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26985): Terminated: ok {rc=0} 02:02:25.862520 --- ParallelTerminationStrategy: PID 26988 died... 02:02:25.881610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26988): Terminated: ok {rc=0} 02:02:25.925882 --- ParallelTerminationStrategy: PID 26991 died... 02:02:25.944925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26991): Terminated: ok {rc=0} 02:02:26.029461 bus /sierra_3: Setting Powered False 02:02:27.127536 bus /sierra_3: Setting Powered False 02:02:28.246143 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 02:02:29.508013 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:02:29.514098 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 02:02:29.577639 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 02:02:29.605304 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 02:02:29.658194 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 02:02:29.723124 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 02:02:29.750525 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 02:02:30.301982 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 02:02:30.308486 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:30.320631 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:02:30.368120 tst handover.py: using LAC 37789 02:02:30.487957 tst handover.py: using RAC 49 02:02:30.609387 tst handover.py: using CellId 37789 02:02:30.727968 tst handover.py: using BVCI 37790 02:02:30.844390 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:02:30.902735 tst handover.py: using LAC 37790 02:02:31.041976 tst handover.py: using RAC 50 02:02:31.170168 tst handover.py: using CellId 37790 02:02:31.325609 tst handover.py: using BVCI 37791 02:02:31.439252 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:31.451192 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:31.463531 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:31.475295 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:31.487848 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:02:31.500222 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:02:31.623548 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:02:31.769324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:02:32.269479 run create_hlr_db(pid=26997): Launched 02:02:32.436938 bus /sierra_2: Setting Powered False 02:02:33.501226 run create_hlr_db(pid=26997): Terminated: ok {rc=0} 02:02:33.914844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26999): Launched 02:02:34.223628 run osmo-hlr_10.42.42.2(pid=27000): Launched 02:02:34.340414 run osmo-stp_10.42.42.5: Starting osmo-stp 02:02:34.844266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27002): Launched 02:02:35.153029 run osmo-stp_10.42.42.5(pid=27003): Launched 02:02:35.270344 run osmo-msc_10.42.42.6: Starting osmo-msc 02:02:35.803777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27005): Launched 02:02:36.117179 run osmo-msc_10.42.42.6(pid=27006): Launched 02:02:36.289642 run osmo-stp_10.42.42.5(pid=27003): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27003)] 02:02:36.419773 run osmo-stp_10.42.42.5(pid=27003): stdout: | (launched: 2022-12-14_02:02:35.095182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:36.549807 run osmo-stp_10.42.42.5(pid=27003): stderr: | [0;m[38;5;43m20221214020235267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020235267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020235268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020235268 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020235269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020235269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020235269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:36.678051 run osmo-stp_10.42.42.5(pid=27003): stdout: | (launched: 2022-12-14_02:02:35.095182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:36.800298 run osmo-stp_10.42.42.5(pid=27003): stderr: | [0;m[38;5;43m20221214020235267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020235267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020235268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020235268 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020235269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020235269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020235269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:36.946995 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27003): Process ended prematurely: osmo-stp_10.42.42.5(pid=27003) [trial-2397↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27003)] [trial-2397↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 02:02:36.955467 tst handover.py:18: Test FAILED (6.6 sec) 02:02:36.981538 run osmo-hlr_10.42.42.2(pid=27000): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27000)] 02:02:37.030114 run osmo-hlr_10.42.42.2(pid=27000): stdout: | (launched: 2022-12-14_02:02:34.166612) 02:02:37.079721 run osmo-hlr_10.42.42.2(pid=27000): stderr: | [0;m[1;31m20221214020234343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020234343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020234343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020234343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020234343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020234343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020234358 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020234367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020234367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020234367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:02:37.148782 run osmo-msc_10.42.42.6(pid=27006): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27006)] 02:02:37.195959 run osmo-msc_10.42.42.6(pid=27006): stdout: | (launched: 2022-12-14_02:02:36.058758) 02:02:37.245241 run osmo-msc_10.42.42.6(pid=27006): stderr: | [0;m[38;5;43m20221214020236331 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020236331 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4396977c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020236331 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020236331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020236331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020236332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020236333 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020236334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020236334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020236334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:02:37.295023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26999): Terminating (SIGTERM) 02:02:37.334996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27002): Terminating (SIGTERM) 02:02:37.374701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27005): Terminating (SIGTERM) 02:02:37.414660 --- ParallelTerminationStrategy: PID 26999 died... 02:02:37.434194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26999): Terminated: ok {rc=0} 02:02:37.478359 --- ParallelTerminationStrategy: PID 27002 died... 02:02:37.498329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27002): Terminated: ok {rc=0} 02:02:37.542457 --- ParallelTerminationStrategy: PID 27005 died... 02:02:37.561451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27005): Terminated: ok {rc=0} 02:02:37.647745 bus /sierra_3: Setting Powered False 02:02:38.746900 bus /sierra_3: Setting Powered False 02:02:39.864246 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 02:02:41.132431 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:02:41.137638 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:02:41.199966 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:02:41.226307 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:02:41.277741 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:02:41.339790 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:02:41.366321 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:02:41.916758 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 02:02:41.922485 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:02:41.933609 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:02:41.980602 tst handover.py: using LAC 37791 02:02:42.103941 tst handover.py: using RAC 51 02:02:42.223086 tst handover.py: using CellId 37791 02:02:42.340662 tst handover.py: using BVCI 37792 02:02:42.451609 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:02:42.498328 tst handover.py: using LAC 37792 02:02:42.626501 tst handover.py: using RAC 52 02:02:42.755046 tst handover.py: using CellId 37792 02:02:42.881067 tst handover.py: using BVCI 37793 02:02:42.999897 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:02:43.011382 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:02:43.022735 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:02:43.033933 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:02:43.045061 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:02:43.056156 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:02:43.173145 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:02:43.292479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:02:43.772007 run create_hlr_db(pid=27011): Launched 02:02:43.906228 bus /sierra_2: Setting Powered False 02:02:44.971157 run create_hlr_db(pid=27011): Terminated: ok {rc=0} 02:02:45.400221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27013): Launched 02:02:45.730438 run osmo-hlr_10.42.42.2(pid=27014): Launched 02:02:45.857175 run osmo-stp_10.42.42.5: Starting osmo-stp 02:02:46.521477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27016): Launched 02:02:46.931239 run osmo-stp_10.42.42.5(pid=27017): Launched 02:02:47.159611 run osmo-msc_10.42.42.6: Starting osmo-msc 02:02:47.782328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27019): Launched 02:02:48.110855 run osmo-msc_10.42.42.6(pid=27020): Launched 02:02:48.295218 run osmo-stp_10.42.42.5(pid=27017): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27017)] 02:02:48.433599 run osmo-stp_10.42.42.5(pid=27017): stdout: | (launched: 2022-12-14_02:02:46.869319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:48.571544 run osmo-stp_10.42.42.5(pid=27017): stderr: | [0;m[38;5;43m20221214020247104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020247104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020247105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020247105 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020247105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020247106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020247106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:48.708236 run osmo-stp_10.42.42.5(pid=27017): stdout: | (launched: 2022-12-14_02:02:46.869319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:02:48.838891 run osmo-stp_10.42.42.5(pid=27017): stderr: | [0;m[38;5;43m20221214020247104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020247104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020247105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020247105 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020247105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020247106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020247106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:02:48.994878 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27017): Process ended prematurely: osmo-stp_10.42.42.5(pid=27017) [trial-2397↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27017)] [trial-2397↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 02:02:49.003918 tst handover.py:18: Test FAILED (7.1 sec) 02:02:49.031281 run osmo-hlr_10.42.42.2(pid=27014): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27014)] 02:02:49.081172 run osmo-hlr_10.42.42.2(pid=27014): stdout: | (launched: 2022-12-14_02:02:45.669803) 02:02:49.132418 run osmo-hlr_10.42.42.2(pid=27014): stderr: | [0;m[1;31m20221214020245963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020245963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020245963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020245963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020245963 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020245964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020245987 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020245999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020245999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020245999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:02:49.203814 run osmo-msc_10.42.42.6(pid=27020): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27020)] 02:02:49.253342 run osmo-msc_10.42.42.6(pid=27020): stdout: | (launched: 2022-12-14_02:02:48.049977) 02:02:49.304637 run osmo-msc_10.42.42.6(pid=27020): stderr: | [0;m[38;5;43m20221214020248373 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020248373 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd152edec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020248373 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020248373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020248373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020248373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020248375 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020248375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020248375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020248375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:02:49.356815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27013): Terminating (SIGTERM) 02:02:49.398416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27016): Terminating (SIGTERM) 02:02:49.440493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27019): Terminating (SIGTERM) 02:02:49.482335 --- ParallelTerminationStrategy: PID 27013 died... 02:02:49.502304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27013): Terminated: ok {rc=0} 02:02:49.548242 --- ParallelTerminationStrategy: PID 27016 died... 02:02:49.567784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27016): Terminated: ok {rc=0} 02:02:49.613294 --- ParallelTerminationStrategy: PID 27019 died... 02:02:49.632685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27019): Terminated: ok {rc=0} 02:02:49.721101 bus /sierra_3: Setting Powered False 02:02:50.819336 bus /sierra_3: Setting Powered False 02:02:51.934291 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 02:02:53.210611 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:02:53.216208 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 02:02:53.276858 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 02:02:53.304174 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 02:02:53.356873 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 02:02:53.418532 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 02:02:53.446019 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 02:02:53.996344 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 02:02:54.002813 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:54.015002 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 02:02:54.062378 tst handover.py: using LAC 37793 02:02:54.190781 tst handover.py: using RAC 53 02:02:54.319496 tst handover.py: using CellId 37793 02:02:54.449507 tst handover.py: using BVCI 37794 02:02:54.569738 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 02:02:54.623076 tst handover.py: using LAC 37794 02:02:54.742324 tst handover.py: using RAC 54 02:02:54.859902 tst handover.py: using CellId 37794 02:02:54.977737 tst handover.py: using BVCI 37795 02:02:55.088430 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:55.099739 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:55.110765 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:55.121912 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:55.133320 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:02:55.144509 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:02:55.268447 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:02:55.388343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:02:55.868010 run create_hlr_db(pid=27025): Launched 02:02:56.002558 bus /sierra_2: Setting Powered False 02:02:57.067315 run create_hlr_db(pid=27025): Terminated: ok {rc=0} 02:02:57.496068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27027): Launched 02:02:57.827831 run osmo-hlr_10.42.42.2(pid=27028): Launched 02:02:57.952726 run osmo-stp_10.42.42.5: Starting osmo-stp 02:02:58.496285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27030): Launched 02:02:58.826838 run osmo-stp_10.42.42.5(pid=27031): Launched 02:02:58.951914 run osmo-msc_10.42.42.6: Starting osmo-msc 02:02:59.519038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27033): Launched 02:02:59.847601 run osmo-msc_10.42.42.6(pid=27034): Launched 02:03:00.032196 run osmo-stp_10.42.42.5(pid=27031): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27031)] 02:03:00.169692 run osmo-stp_10.42.42.5(pid=27031): stdout: | (launched: 2022-12-14_02:02:58.764894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:00.307739 run osmo-stp_10.42.42.5(pid=27031): stderr: | [0;m[38;5;43m20221214020258959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020258959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020258960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020258960 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020258961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020258961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020258961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:00.444701 run osmo-stp_10.42.42.5(pid=27031): stdout: | (launched: 2022-12-14_02:02:58.764894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:00.574859 run osmo-stp_10.42.42.5(pid=27031): stderr: | [0;m[38;5;43m20221214020258959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020258959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020258960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020258960 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020258961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020258961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020258961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:00.730546 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27031): Process ended prematurely: osmo-stp_10.42.42.5(pid=27031) [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27031)] [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 02:03:00.739463 tst handover.py:18: Test FAILED (6.7 sec) 02:03:00.766875 run osmo-hlr_10.42.42.2(pid=27028): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27028)] 02:03:00.816505 run osmo-hlr_10.42.42.2(pid=27028): stdout: | (launched: 2022-12-14_02:02:57.765711) 02:03:00.868827 run osmo-hlr_10.42.42.2(pid=27028): stderr: | [0;m[1;31m20221214020257966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020257966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020257966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020257966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020257966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020257966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020257981 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020257989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020257989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020257989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:03:00.966455 run osmo-msc_10.42.42.6(pid=27034): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27034)] 02:03:01.020489 run osmo-msc_10.42.42.6(pid=27034): stdout: | (launched: 2022-12-14_02:02:59.786653) 02:03:01.073231 run osmo-msc_10.42.42.6(pid=27034): stderr: | [0;m[38;5;43m20221214020300108 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020300108 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa5d571ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020300108 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020300108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020300109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020300109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020300110 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020300111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020300111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020300111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:03:01.125251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27027): Terminating (SIGTERM) 02:03:01.168501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27030): Terminating (SIGTERM) 02:03:01.212830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27033): Terminating (SIGTERM) 02:03:01.258626 --- ParallelTerminationStrategy: PID 27027 died... 02:03:01.279964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27027): Terminated: ok {rc=0} 02:03:01.345008 --- ParallelTerminationStrategy: PID 27030 died... 02:03:01.372152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27030): Terminated: ok {rc=0} 02:03:01.418679 --- ParallelTerminationStrategy: PID 27033 died... 02:03:01.440548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27033): Terminated: ok {rc=0} 02:03:01.529832 bus /sierra_3: Setting Powered False 02:03:02.628698 bus /sierra_3: Setting Powered False 02:03:03.745020 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 02:03:05.034892 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:03:05.040690 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 02:03:05.088632 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 02:03:05.116110 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 02:03:05.169478 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 02:03:05.216274 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 02:03:05.242781 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 02:03:05.797970 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 02:03:05.804616 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:05.815858 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 02:03:05.861403 tst handover.py: using LAC 37795 02:03:05.981630 tst handover.py: using RAC 55 02:03:06.113381 tst handover.py: using CellId 37795 02:03:06.243845 tst handover.py: using BVCI 37796 02:03:06.366143 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 02:03:06.402999 tst handover.py: using LAC 37796 02:03:06.533409 tst handover.py: using RAC 56 02:03:06.663799 tst handover.py: using CellId 37796 02:03:06.791493 tst handover.py: using BVCI 37797 02:03:06.911632 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:06.923135 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:06.934467 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:06.945912 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:06.957341 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:06.968596 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 02:03:07.084811 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 02:03:07.203152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:03:07.653613 run create_hlr_db(pid=27040): Launched 02:03:07.773101 bus /sierra_2: Setting Powered False 02:03:08.834127 run create_hlr_db(pid=27040): Terminated: ok {rc=0} 02:03:09.237548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27042): Launched 02:03:09.547027 run osmo-hlr_10.42.42.2(pid=27043): Launched 02:03:09.666230 run osmo-stp_10.42.42.5: Starting osmo-stp 02:03:10.181371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27045): Launched 02:03:10.489258 run osmo-stp_10.42.42.5(pid=27046): Launched 02:03:10.606670 run osmo-msc_10.42.42.6: Starting osmo-msc 02:03:11.133636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27048): Launched 02:03:11.442259 run osmo-msc_10.42.42.6(pid=27049): Launched 02:03:11.615115 run osmo-stp_10.42.42.5(pid=27046): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27046)] 02:03:11.744216 run osmo-stp_10.42.42.5(pid=27046): stdout: | (launched: 2022-12-14_02:03:10.431663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:11.873365 run osmo-stp_10.42.42.5(pid=27046): stderr: | [0;m[38;5;43m20221214020310603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020310603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020310603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020310604 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020310604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020310605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020310605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:12.000333 run osmo-stp_10.42.42.5(pid=27046): stdout: | (launched: 2022-12-14_02:03:10.431663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:12.122691 run osmo-stp_10.42.42.5(pid=27046): stderr: | [0;m[38;5;43m20221214020310603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020310603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020310603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020310604 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020310604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020310605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020310605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:12.268119 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27046): Process ended prematurely: osmo-stp_10.42.42.5(pid=27046) [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27046)] [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 02:03:12.276650 tst handover.py:18: Test FAILED (6.5 sec) 02:03:12.302899 run osmo-hlr_10.42.42.2(pid=27043): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27043)] 02:03:12.351321 run osmo-hlr_10.42.42.2(pid=27043): stdout: | (launched: 2022-12-14_02:03:09.489681) 02:03:12.400782 run osmo-hlr_10.42.42.2(pid=27043): stderr: | [0;m[1;31m20221214020309669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020309669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020309669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020309669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020309669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020309669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020309682 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020309690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020309690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020309690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:03:12.470028 run osmo-msc_10.42.42.6(pid=27049): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27049)] 02:03:12.517084 run osmo-msc_10.42.42.6(pid=27049): stdout: | (launched: 2022-12-14_02:03:11.384584) 02:03:12.566157 run osmo-msc_10.42.42.6(pid=27049): stderr: | [0;m[38;5;43m20221214020311658 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020311658 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6eab707c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020311658 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020311658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020311658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020311658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020311660 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020311660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020311661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020311661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:03:12.615542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27042): Terminating (SIGTERM) 02:03:12.655301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27045): Terminating (SIGTERM) 02:03:12.694961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27048): Terminating (SIGTERM) 02:03:12.734786 --- ParallelTerminationStrategy: PID 27042 died... 02:03:12.754374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27042): Terminated: ok {rc=0} 02:03:12.798868 --- ParallelTerminationStrategy: PID 27045 died... 02:03:12.818044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27045): Terminated: ok {rc=0} 02:03:12.861938 --- ParallelTerminationStrategy: PID 27048 died... 02:03:12.880795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27048): Terminated: ok {rc=0} 02:03:12.966952 bus /sierra_3: Setting Powered False 02:03:14.065481 bus /sierra_3: Setting Powered False 02:03:15.180279 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 02:03:16.473713 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:03:16.483220 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 02:03:16.560774 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 02:03:16.594216 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 02:03:16.662082 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 02:03:16.747350 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 02:03:16.784118 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 02:03:17.298581 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 02:03:17.305300 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:17.317251 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:03:17.363734 tst handover.py: using LAC 37797 02:03:17.485575 tst handover.py: using RAC 57 02:03:17.607538 tst handover.py: using CellId 37797 02:03:17.729329 tst handover.py: using BVCI 37798 02:03:17.840555 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:03:17.889816 tst handover.py: using LAC 37798 02:03:18.019454 tst handover.py: using RAC 58 02:03:18.150843 tst handover.py: using CellId 37798 02:03:18.279769 tst handover.py: using BVCI 37799 02:03:18.402257 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:18.413950 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:18.425442 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:18.436806 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:18.449060 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:18.460806 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:03:18.579287 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:03:18.699965 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:03:19.181786 run create_hlr_db(pid=27054): Launched 02:03:19.315770 bus /sierra_2: Setting Powered False 02:03:20.380675 run create_hlr_db(pid=27054): Terminated: ok {rc=0} 02:03:20.796125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27056): Launched 02:03:21.104814 run osmo-hlr_10.42.42.2(pid=27057): Launched 02:03:21.222930 run osmo-stp_10.42.42.5: Starting osmo-stp 02:03:21.739694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27059): Launched 02:03:22.049235 run osmo-stp_10.42.42.5(pid=27060): Launched 02:03:22.166646 run osmo-msc_10.42.42.6: Starting osmo-msc 02:03:22.695824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27062): Launched 02:03:23.005238 run osmo-msc_10.42.42.6(pid=27063): Launched 02:03:23.176338 run osmo-stp_10.42.42.5(pid=27060): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27060)] 02:03:23.306540 run osmo-stp_10.42.42.5(pid=27060): stdout: | (launched: 2022-12-14_02:03:21.991958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:23.435599 run osmo-stp_10.42.42.5(pid=27060): stderr: | [0;m[38;5;43m20221214020322164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020322164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020322164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020322165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020322165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020322165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020322165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:23.562808 run osmo-stp_10.42.42.5(pid=27060): stdout: | (launched: 2022-12-14_02:03:21.991958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:23.684258 run osmo-stp_10.42.42.5(pid=27060): stderr: | [0;m[38;5;43m20221214020322164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020322164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020322164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020322165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020322165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020322165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020322165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:23.830213 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27060): Process ended prematurely: osmo-stp_10.42.42.5(pid=27060) [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27060)] [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 02:03:23.838691 tst handover.py:18: Test FAILED (6.5 sec) 02:03:23.865348 run osmo-hlr_10.42.42.2(pid=27057): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27057)] 02:03:23.913315 run osmo-hlr_10.42.42.2(pid=27057): stdout: | (launched: 2022-12-14_02:03:21.047033) 02:03:23.962436 run osmo-hlr_10.42.42.2(pid=27057): stderr: | [0;m[1;31m20221214020321223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020321223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020321223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020321223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020321223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020321223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020321236 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020321244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020321244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020321244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:03:24.031629 run osmo-msc_10.42.42.6(pid=27063): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27063)] 02:03:24.078551 run osmo-msc_10.42.42.6(pid=27063): stdout: | (launched: 2022-12-14_02:03:22.947936) 02:03:24.127513 run osmo-msc_10.42.42.6(pid=27063): stderr: | [0;m[38;5;43m20221214020323217 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020323218 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fce303b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020323218 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020323218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020323218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020323218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020323220 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020323220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020323220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020323220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:03:24.176766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27056): Terminating (SIGTERM) 02:03:24.216401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27059): Terminating (SIGTERM) 02:03:24.256443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27062): Terminating (SIGTERM) 02:03:24.296424 --- ParallelTerminationStrategy: PID 27056 died... 02:03:24.315913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27056): Terminated: ok {rc=0} 02:03:24.360240 --- ParallelTerminationStrategy: PID 27059 died... 02:03:24.379247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27059): Terminated: ok {rc=0} 02:03:24.422981 --- ParallelTerminationStrategy: PID 27062 died... 02:03:24.442086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27062): Terminated: ok {rc=0} 02:03:24.528279 bus /sierra_3: Setting Powered False 02:03:25.628515 bus /sierra_3: Setting Powered False 02:03:26.746626 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 02:03:28.024385 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:03:28.030568 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:03:28.090517 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:03:28.117844 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:03:28.171489 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:03:28.229288 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:03:28.255813 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:03:28.812391 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 02:03:28.818917 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:28.830356 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:03:28.874812 tst handover.py: using LAC 37799 02:03:29.005173 tst handover.py: using RAC 59 02:03:29.133386 tst handover.py: using CellId 37799 02:03:29.262231 tst handover.py: using BVCI 37800 02:03:29.383472 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:03:29.432719 tst handover.py: using LAC 37800 02:03:29.562071 tst handover.py: using RAC 60 02:03:29.692261 tst handover.py: using CellId 37800 02:03:29.820773 tst handover.py: using BVCI 37801 02:03:29.942368 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:29.954318 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:29.965718 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:29.977176 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:29.989146 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:03:30.001090 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:03:30.119258 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:03:30.241553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:03:30.691206 run create_hlr_db(pid=27068): Launched 02:03:30.808585 bus /sierra_2: Setting Powered False 02:03:31.889516 run create_hlr_db(pid=27068): Terminated: ok {rc=0} 02:03:32.373143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27070): Launched 02:03:32.705118 run osmo-hlr_10.42.42.2(pid=27071): Launched 02:03:32.830810 run osmo-stp_10.42.42.5: Starting osmo-stp 02:03:33.371669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27073): Launched 02:03:33.701098 run osmo-stp_10.42.42.5(pid=27074): Launched 02:03:33.827928 run osmo-msc_10.42.42.6: Starting osmo-msc 02:03:34.392857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27076): Launched 02:03:34.723960 run osmo-msc_10.42.42.6(pid=27077): Launched 02:03:34.908504 run osmo-stp_10.42.42.5(pid=27074): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27074)] 02:03:35.046329 run osmo-stp_10.42.42.5(pid=27074): stdout: | (launched: 2022-12-14_02:03:33.640047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:35.184589 run osmo-stp_10.42.42.5(pid=27074): stderr: | [0;m[38;5;43m20221214020333836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020333836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020333837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020333837 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020333838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020333838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020333838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:35.321605 run osmo-stp_10.42.42.5(pid=27074): stdout: | (launched: 2022-12-14_02:03:33.640047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:35.452518 run osmo-stp_10.42.42.5(pid=27074): stderr: | [0;m[38;5;43m20221214020333836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020333836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020333837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020333837 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020333838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020333838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020333838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:35.608469 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27074): Process ended prematurely: osmo-stp_10.42.42.5(pid=27074) [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27074)] [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 02:03:35.617639 tst handover.py:18: Test FAILED (6.8 sec) 02:03:35.645491 run osmo-hlr_10.42.42.2(pid=27071): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27071)] 02:03:35.695535 run osmo-hlr_10.42.42.2(pid=27071): stdout: | (launched: 2022-12-14_02:03:32.643730) 02:03:35.746974 run osmo-hlr_10.42.42.2(pid=27071): stderr: | [0;m[1;31m20221214020332842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020332842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020332842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020332843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020332843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020332843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020332855 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020332863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020332864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020332864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:03:35.818771 run osmo-msc_10.42.42.6(pid=27077): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27077)] 02:03:35.868505 run osmo-msc_10.42.42.6(pid=27077): stdout: | (launched: 2022-12-14_02:03:34.663239) 02:03:35.919809 run osmo-msc_10.42.42.6(pid=27077): stderr: | [0;m[38;5;43m20221214020334985 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020334986 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f61f52c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020334986 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020334986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020334986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020334986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020334988 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020334988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020334988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020334988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:03:35.971455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27070): Terminating (SIGTERM) 02:03:36.012662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27073): Terminating (SIGTERM) 02:03:36.054138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27076): Terminating (SIGTERM) 02:03:36.095915 --- ParallelTerminationStrategy: PID 27070 died... 02:03:36.116283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27070): Terminated: ok {rc=0} 02:03:36.162502 --- ParallelTerminationStrategy: PID 27073 died... 02:03:36.182081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27073): Terminated: ok {rc=0} 02:03:36.227671 --- ParallelTerminationStrategy: PID 27076 died... 02:03:36.247383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27076): Terminated: ok {rc=0} 02:03:36.335043 bus /sierra_3: Setting Powered False 02:03:37.432998 bus /sierra_3: Setting Powered False 02:03:38.548279 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 02:03:39.815694 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:03:39.820887 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 02:03:39.873153 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 02:03:39.899352 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 02:03:39.954950 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 02:03:40.006925 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 02:03:40.033276 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 02:03:40.579283 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 02:03:40.584535 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:40.595587 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 02:03:40.645530 tst handover.py: using LAC 37801 02:03:40.775568 tst handover.py: using RAC 61 02:03:40.898519 tst handover.py: using CellId 37801 02:03:41.019360 tst handover.py: using BVCI 37802 02:03:41.133105 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 02:03:41.168586 tst handover.py: using LAC 37802 02:03:41.300488 tst handover.py: using RAC 62 02:03:41.429385 tst handover.py: using CellId 37802 02:03:41.558739 tst handover.py: using BVCI 37803 02:03:41.679396 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:41.691067 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:41.702587 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:41.714069 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:41.725764 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 02:03:41.737464 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 02:03:41.855124 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 02:03:41.975151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:03:42.457683 run create_hlr_db(pid=27082): Launched 02:03:42.592558 bus /sierra_2: Setting Powered False 02:03:43.657705 run create_hlr_db(pid=27082): Terminated: ok {rc=0} 02:03:44.071590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27084): Launched 02:03:44.381066 run osmo-hlr_10.42.42.2(pid=27085): Launched 02:03:44.499063 run osmo-stp_10.42.42.5: Starting osmo-stp 02:03:45.019720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27087): Launched 02:03:45.328445 run osmo-stp_10.42.42.5(pid=27088): Launched 02:03:45.446037 run osmo-msc_10.42.42.6: Starting osmo-msc 02:03:45.993701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27090): Launched 02:03:46.323241 run osmo-msc_10.42.42.6(pid=27091): Launched 02:03:46.700508 run osmo-stp_10.42.42.5(pid=27088): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27088)] 02:03:47.002164 run osmo-stp_10.42.42.5(pid=27088): stdout: | (launched: 2022-12-14_02:03:45.271151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:47.209094 run osmo-stp_10.42.42.5(pid=27088): stderr: | [0;m[38;5;43m20221214020345441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020345441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020345442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020345442 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020345442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020345442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020345443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:47.338768 run osmo-stp_10.42.42.5(pid=27088): stdout: | (launched: 2022-12-14_02:03:45.271151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:47.460052 run osmo-stp_10.42.42.5(pid=27088): stderr: | [0;m[38;5;43m20221214020345441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020345441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020345442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020345442 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020345442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020345442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020345443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:47.606358 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27088): Process ended prematurely: osmo-stp_10.42.42.5(pid=27088) [trial-2397↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27088)] [trial-2397↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 02:03:47.614786 tst handover.py:18: Test FAILED (7.0 sec) 02:03:47.641173 run osmo-hlr_10.42.42.2(pid=27085): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27085)] 02:03:47.689664 run osmo-hlr_10.42.42.2(pid=27085): stdout: | (launched: 2022-12-14_02:03:44.323221) 02:03:47.739477 run osmo-hlr_10.42.42.2(pid=27085): stderr: | [0;m[1;31m20221214020344501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020344501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020344501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020344501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020344501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020344501 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020344513 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020344521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020344521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020344521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:03:47.809211 run osmo-msc_10.42.42.6(pid=27091): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27091)] 02:03:47.856922 run osmo-msc_10.42.42.6(pid=27091): stdout: | (launched: 2022-12-14_02:03:46.264252) 02:03:47.906530 run osmo-msc_10.42.42.6(pid=27091): stderr: | [0;m[38;5;43m20221214020346734 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020346734 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f391d1c9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020346734 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020346734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020346734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020346734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020346736 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020346736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020346736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020346737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:03:47.956632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27084): Terminating (SIGTERM) 02:03:47.996929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27087): Terminating (SIGTERM) 02:03:48.037199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27090): Terminating (SIGTERM) 02:03:48.078207 --- ParallelTerminationStrategy: PID 27084 died... 02:03:48.097813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27084): Terminated: ok {rc=0} 02:03:48.142522 --- ParallelTerminationStrategy: PID 27087 died... 02:03:48.161674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27087): Terminated: ok {rc=0} 02:03:48.206831 --- ParallelTerminationStrategy: PID 27090 died... 02:03:48.226037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27090): Terminated: ok {rc=0} 02:03:48.312443 bus /sierra_3: Setting Powered False 02:03:49.411976 bus /sierra_3: Setting Powered False 02:03:50.524259 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 02:03:51.785396 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:03:51.791259 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 02:03:51.856610 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 02:03:51.883846 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 02:03:51.937055 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 02:03:52.005150 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 02:03:52.032295 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 02:03:52.583023 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 02:03:52.588508 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:52.599883 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:03:52.652237 tst handover.py: using LAC 37803 02:03:52.783912 tst handover.py: using RAC 63 02:03:52.913502 tst handover.py: using CellId 37803 02:03:53.039063 tst handover.py: using BVCI 37804 02:03:53.151935 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:03:53.201960 tst handover.py: using LAC 37804 02:03:53.320596 tst handover.py: using RAC 64 02:03:53.439968 tst handover.py: using CellId 37804 02:03:53.569091 tst handover.py: using BVCI 37805 02:03:53.688282 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:53.699727 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:53.710929 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:53.722309 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:53.733586 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:03:53.744792 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:03:53.862645 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:03:53.981802 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:03:54.464846 run create_hlr_db(pid=27096): Launched 02:03:54.599538 bus /sierra_2: Setting Powered False 02:03:55.664413 run create_hlr_db(pid=27096): Terminated: ok {rc=0} 02:03:56.079178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27098): Launched 02:03:56.387790 run osmo-hlr_10.42.42.2(pid=27099): Launched 02:03:56.505241 run osmo-stp_10.42.42.5: Starting osmo-stp 02:03:57.011210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27101): Launched 02:03:57.320414 run osmo-stp_10.42.42.5(pid=27102): Launched 02:03:57.439737 run osmo-msc_10.42.42.6: Starting osmo-msc 02:03:57.968583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27104): Launched 02:03:58.277678 run osmo-msc_10.42.42.6(pid=27105): Launched 02:03:58.451446 run osmo-stp_10.42.42.5(pid=27102): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27102)] 02:03:58.581301 run osmo-stp_10.42.42.5(pid=27102): stdout: | (launched: 2022-12-14_02:03:57.263288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:58.711494 run osmo-stp_10.42.42.5(pid=27102): stderr: | [0;m[38;5;43m20221214020357435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020357435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020357435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020357436 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020357436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020357436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020357436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:58.839290 run osmo-stp_10.42.42.5(pid=27102): stdout: | (launched: 2022-12-14_02:03:57.263288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:03:58.961555 run osmo-stp_10.42.42.5(pid=27102): stderr: | [0;m[38;5;43m20221214020357435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020357435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020357435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020357436 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020357436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020357436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020357436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:03:59.108114 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27102): Process ended prematurely: osmo-stp_10.42.42.5(pid=27102) [trial-2397↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27102)] [trial-2397↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 02:03:59.116704 tst handover.py:18: Test FAILED (6.5 sec) 02:03:59.142988 run osmo-hlr_10.42.42.2(pid=27099): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27099)] 02:03:59.191533 run osmo-hlr_10.42.42.2(pid=27099): stdout: | (launched: 2022-12-14_02:03:56.330833) 02:03:59.240494 run osmo-hlr_10.42.42.2(pid=27099): stderr: | [0;m[1;31m20221214020356505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020356505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020356505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020356506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020356506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020356506 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020356518 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020356526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020356526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020356526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:03:59.309321 run osmo-msc_10.42.42.6(pid=27105): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27105)] 02:03:59.356581 run osmo-msc_10.42.42.6(pid=27105): stdout: | (launched: 2022-12-14_02:03:58.220039) 02:03:59.405645 run osmo-msc_10.42.42.6(pid=27105): stderr: | [0;m[38;5;43m20221214020358492 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020358493 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa65f226c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020358493 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020358493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020358493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020358493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020358495 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020358495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020358495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020358495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:03:59.455168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27098): Terminating (SIGTERM) 02:03:59.494787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27101): Terminating (SIGTERM) 02:03:59.534430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27104): Terminating (SIGTERM) 02:03:59.574146 --- ParallelTerminationStrategy: PID 27098 died... 02:03:59.593698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27098): Terminated: ok {rc=0} 02:03:59.637629 --- ParallelTerminationStrategy: PID 27101 died... 02:03:59.656511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27101): Terminated: ok {rc=0} 02:03:59.700714 --- ParallelTerminationStrategy: PID 27104 died... 02:03:59.719644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27104): Terminated: ok {rc=0} 02:03:59.805224 bus /sierra_3: Setting Powered False 02:04:00.918955 bus /sierra_3: Setting Powered False 02:04:02.040925 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 02:04:03.323182 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:04:03.329505 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:04:03.394377 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:04:03.421626 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:04:03.476068 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:04:03.540714 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:04:03.567842 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:04:04.114586 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 02:04:04.120135 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:04.131368 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:04:04.182937 tst handover.py: using LAC 37805 02:04:04.310177 tst handover.py: using RAC 65 02:04:04.437173 tst handover.py: using CellId 37805 02:04:04.564180 tst handover.py: using BVCI 37806 02:04:04.680771 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:04:04.727712 tst handover.py: using LAC 37806 02:04:04.856554 tst handover.py: using RAC 66 02:04:04.982213 tst handover.py: using CellId 37806 02:04:05.108046 tst handover.py: using BVCI 37807 02:04:05.226721 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:05.238334 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:05.249769 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:05.261216 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:05.272645 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:05.284387 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:04:05.405371 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:04:05.522502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:04:05.972430 run create_hlr_db(pid=27110): Launched 02:04:06.091820 bus /sierra_2: Setting Powered False 02:04:07.152117 run create_hlr_db(pid=27110): Terminated: ok {rc=0} 02:04:07.554531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27112): Launched 02:04:07.862513 run osmo-hlr_10.42.42.2(pid=27113): Launched 02:04:07.980065 run osmo-stp_10.42.42.5: Starting osmo-stp 02:04:08.497574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27115): Launched 02:04:08.807163 run osmo-stp_10.42.42.5(pid=27116): Launched 02:04:08.925659 run osmo-msc_10.42.42.6: Starting osmo-msc 02:04:09.450702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27118): Launched 02:04:09.758932 run osmo-msc_10.42.42.6(pid=27119): Launched 02:04:09.932122 run osmo-stp_10.42.42.5(pid=27116): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27116)] 02:04:10.061178 run osmo-stp_10.42.42.5(pid=27116): stdout: | (launched: 2022-12-14_02:04:08.748843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:10.189897 run osmo-stp_10.42.42.5(pid=27116): stderr: | [0;m[38;5;43m20221214020408921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020408921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020408921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020408922 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020408922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020408922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020408922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:10.316714 run osmo-stp_10.42.42.5(pid=27116): stdout: | (launched: 2022-12-14_02:04:08.748843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:10.438502 run osmo-stp_10.42.42.5(pid=27116): stderr: | [0;m[38;5;43m20221214020408921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020408921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020408921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020408922 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020408922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020408922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020408922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:10.583720 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27116): Process ended prematurely: osmo-stp_10.42.42.5(pid=27116) [trial-2397↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27116)] [trial-2397↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 02:04:10.592192 tst handover.py:18: Test FAILED (6.5 sec) 02:04:10.618056 run osmo-hlr_10.42.42.2(pid=27113): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27113)] 02:04:10.665950 run osmo-hlr_10.42.42.2(pid=27113): stdout: | (launched: 2022-12-14_02:04:07.805291) 02:04:10.715190 run osmo-hlr_10.42.42.2(pid=27113): stderr: | [0;m[1;31m20221214020407982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020407982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020407982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020407982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020407982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020407982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020407997 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020408006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020408006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020408006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:04:10.783962 run osmo-msc_10.42.42.6(pid=27119): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27119)] 02:04:10.831912 run osmo-msc_10.42.42.6(pid=27119): stdout: | (launched: 2022-12-14_02:04:09.701702) 02:04:10.881116 run osmo-msc_10.42.42.6(pid=27119): stderr: | [0;m[38;5;43m20221214020409972 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020409972 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f01f608fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020409972 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020409972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020409972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020409973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020409974 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020409975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020409975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020409975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:04:10.930540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27112): Terminating (SIGTERM) 02:04:10.970110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27115): Terminating (SIGTERM) 02:04:11.009622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27118): Terminating (SIGTERM) 02:04:11.049558 --- ParallelTerminationStrategy: PID 27112 died... 02:04:11.069112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27112): Terminated: ok {rc=0} 02:04:11.113232 --- ParallelTerminationStrategy: PID 27115 died... 02:04:11.132151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27115): Terminated: ok {rc=0} 02:04:11.175872 --- ParallelTerminationStrategy: PID 27118 died... 02:04:11.194828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27118): Terminated: ok {rc=0} 02:04:11.280303 bus /sierra_3: Setting Powered False 02:04:12.379349 bus /sierra_3: Setting Powered False 02:04:13.489795 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 02:04:14.765208 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:04:14.770756 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 02:04:14.822496 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 02:04:14.850296 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 02:04:14.903183 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 02:04:14.954078 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 02:04:14.980402 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 02:04:15.532643 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 02:04:15.538178 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:04:15.549111 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:04:15.582499 tst handover.py: using LAC 37807 02:04:15.709354 tst handover.py: using RAC 67 02:04:15.835461 tst handover.py: using CellId 37807 02:04:15.983107 tst handover.py: using BVCI 37808 02:04:16.110682 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 02:04:16.162690 tst handover.py: using LAC 37808 02:04:16.299024 tst handover.py: using RAC 68 02:04:16.429767 tst handover.py: using CellId 37808 02:04:16.559717 tst handover.py: using BVCI 37809 02:04:16.679679 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:04:16.691749 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:04:16.703539 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:04:16.715668 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:04:16.728637 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 02:04:16.741486 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:04:16.860783 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 02:04:16.983383 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:04:17.440872 run create_hlr_db(pid=27124): Launched 02:04:17.560045 bus /sierra_2: Setting Powered False 02:04:18.621809 run create_hlr_db(pid=27124): Terminated: ok {rc=0} 02:04:19.045681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27126): Launched 02:04:19.378895 run osmo-hlr_10.42.42.2(pid=27127): Launched 02:04:19.504445 run osmo-stp_10.42.42.5: Starting osmo-stp 02:04:20.042550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27129): Launched 02:04:20.372352 run osmo-stp_10.42.42.5(pid=27130): Launched 02:04:20.499864 run osmo-msc_10.42.42.6: Starting osmo-msc 02:04:21.066439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27132): Launched 02:04:21.397471 run osmo-msc_10.42.42.6(pid=27133): Launched 02:04:21.582129 run osmo-stp_10.42.42.5(pid=27130): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27130)] 02:04:21.719907 run osmo-stp_10.42.42.5(pid=27130): stdout: | (launched: 2022-12-14_02:04:20.311512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:21.858433 run osmo-stp_10.42.42.5(pid=27130): stderr: | [0;m[38;5;43m20221214020420504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020420505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020420505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020420505 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020420506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020420506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020420506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:21.995677 run osmo-stp_10.42.42.5(pid=27130): stdout: | (launched: 2022-12-14_02:04:20.311512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:22.126682 run osmo-stp_10.42.42.5(pid=27130): stderr: | [0;m[38;5;43m20221214020420504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020420505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020420505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020420505 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020420506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020420506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020420506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:22.283583 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27130): Process ended prematurely: osmo-stp_10.42.42.5(pid=27130) [trial-2397↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27130)] [trial-2397↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 02:04:22.292740 tst handover.py:18: Test FAILED (6.7 sec) 02:04:22.320461 run osmo-hlr_10.42.42.2(pid=27127): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27127)] 02:04:22.370319 run osmo-hlr_10.42.42.2(pid=27127): stdout: | (launched: 2022-12-14_02:04:19.317203) 02:04:22.421978 run osmo-hlr_10.42.42.2(pid=27127): stderr: | [0;m[1;31m20221214020419517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020419517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020419517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020419517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020419517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020419518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020419533 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020419542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020419543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020419543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:04:22.493523 run osmo-msc_10.42.42.6(pid=27133): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27133)] 02:04:22.543285 run osmo-msc_10.42.42.6(pid=27133): stdout: | (launched: 2022-12-14_02:04:21.336354) 02:04:22.594592 run osmo-msc_10.42.42.6(pid=27133): stderr: | [0;m[38;5;43m20221214020421660 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020421661 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbf3cf3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020421661 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020421661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020421661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020421661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020421663 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020421664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020421664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020421664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:04:22.646088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27126): Terminating (SIGTERM) 02:04:22.687342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27129): Terminating (SIGTERM) 02:04:22.728829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27132): Terminating (SIGTERM) 02:04:22.770599 --- ParallelTerminationStrategy: PID 27126 died... 02:04:22.790938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27126): Terminated: ok {rc=0} 02:04:22.837090 --- ParallelTerminationStrategy: PID 27129 died... 02:04:22.856833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27129): Terminated: ok {rc=0} 02:04:22.903083 --- ParallelTerminationStrategy: PID 27132 died... 02:04:22.922911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27132): Terminated: ok {rc=0} 02:04:23.010389 bus /sierra_3: Setting Powered False 02:04:24.109852 bus /sierra_3: Setting Powered False 02:04:25.225728 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 02:04:26.484616 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:04:26.490440 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:04:26.541680 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:04:26.569081 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:04:26.622082 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:04:26.673804 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:04:26.700940 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:04:27.249816 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 02:04:27.255176 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:27.266208 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:04:27.299652 tst handover.py: using LAC 37809 02:04:27.419418 tst handover.py: using RAC 69 02:04:27.540515 tst handover.py: using CellId 37809 02:04:27.660647 tst handover.py: using BVCI 37810 02:04:27.773134 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:04:27.820096 tst handover.py: using LAC 37810 02:04:27.943249 tst handover.py: using RAC 70 02:04:28.062624 tst handover.py: using CellId 37810 02:04:28.183389 tst handover.py: using BVCI 37811 02:04:28.295702 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:28.306675 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:28.317474 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:28.328206 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:28.339765 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:28.350903 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:04:28.468471 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:04:28.588144 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:04:29.070109 run create_hlr_db(pid=27138): Launched 02:04:29.203434 bus /sierra_2: Setting Powered False 02:04:30.267967 run create_hlr_db(pid=27138): Terminated: ok {rc=0} 02:04:30.681434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27140): Launched 02:04:31.008213 run osmo-hlr_10.42.42.2(pid=27141): Launched 02:04:31.263950 run osmo-stp_10.42.42.5: Starting osmo-stp 02:04:31.883841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27143): Launched 02:04:32.213690 run osmo-stp_10.42.42.5(pid=27144): Launched 02:04:32.434933 run osmo-msc_10.42.42.6: Starting osmo-msc 02:04:32.962920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27146): Launched 02:04:33.272123 run osmo-msc_10.42.42.6(pid=27147): Launched 02:04:33.445529 run osmo-stp_10.42.42.5(pid=27144): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27144)] 02:04:33.575010 run osmo-stp_10.42.42.5(pid=27144): stdout: | (launched: 2022-12-14_02:04:32.153152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:33.703991 run osmo-stp_10.42.42.5(pid=27144): stderr: | [0;m[38;5;43m20221214020432328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020432328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020432328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020432329 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020432329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020432329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020432329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:33.831065 run osmo-stp_10.42.42.5(pid=27144): stdout: | (launched: 2022-12-14_02:04:32.153152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:33.952545 run osmo-stp_10.42.42.5(pid=27144): stderr: | [0;m[38;5;43m20221214020432328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020432328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020432328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020432329 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020432329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020432329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020432329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:34.098673 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27144): Process ended prematurely: osmo-stp_10.42.42.5(pid=27144) [trial-2397↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27144)] [trial-2397↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 02:04:34.107035 tst handover.py:18: Test FAILED (6.8 sec) 02:04:34.133273 run osmo-hlr_10.42.42.2(pid=27141): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27141)] 02:04:34.181536 run osmo-hlr_10.42.42.2(pid=27141): stdout: | (launched: 2022-12-14_02:04:30.949658) 02:04:34.230928 run osmo-hlr_10.42.42.2(pid=27141): stderr: | [0;m[1;31m20221214020431229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020431229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020431229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020431229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020431229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020431229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020431247 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020431259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020431259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020431259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:04:34.300385 run osmo-msc_10.42.42.6(pid=27147): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27147)] 02:04:34.347931 run osmo-msc_10.42.42.6(pid=27147): stdout: | (launched: 2022-12-14_02:04:33.214738) 02:04:34.397217 run osmo-msc_10.42.42.6(pid=27147): stderr: | [0;m[38;5;43m20221214020433485 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020433485 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2de6730c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020433485 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020433485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020433486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020433486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020433488 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020433488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020433488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020433489 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:04:34.446659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27140): Terminating (SIGTERM) 02:04:34.486343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27143): Terminating (SIGTERM) 02:04:34.526046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27146): Terminating (SIGTERM) 02:04:34.565959 --- ParallelTerminationStrategy: PID 27140 died... 02:04:34.584741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27140): Terminated: ok {rc=0} 02:04:34.628875 --- ParallelTerminationStrategy: PID 27143 died... 02:04:34.647678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27143): Terminated: ok {rc=0} 02:04:34.691760 --- ParallelTerminationStrategy: PID 27146 died... 02:04:34.710634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27146): Terminated: ok {rc=0} 02:04:34.796353 bus /sierra_3: Setting Powered False 02:04:35.894881 bus /sierra_3: Setting Powered False 02:04:37.010900 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2397 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 02:04:38.278734 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:04:38.285599 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 02:04:38.349360 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:04:38.376801 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 02:04:38.437589 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 02:04:38.502394 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:04:38.529561 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 02:04:39.072868 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2397 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 02:04:39.078491 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:39.089824 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:04:39.140470 tst handover.py: using LAC 37811 02:04:39.261657 tst handover.py: using RAC 71 02:04:39.390507 tst handover.py: using CellId 37811 02:04:39.518333 tst handover.py: using BVCI 37812 02:04:39.639459 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 02:04:39.687396 tst handover.py: using LAC 37812 02:04:39.814466 tst handover.py: using RAC 72 02:04:39.942574 tst handover.py: using CellId 37812 02:04:40.069508 tst handover.py: using BVCI 37813 02:04:40.184110 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:40.195241 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:40.206304 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:40.217035 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:40.228140 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 02:04:40.239060 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:04:40.353809 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 02:04:40.472779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:04:40.953702 run create_hlr_db(pid=27152): Launched 02:04:41.088189 bus /sierra_2: Setting Powered False 02:04:42.151050 run create_hlr_db(pid=27152): Terminated: ok {rc=0} 02:04:42.581337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27154): Launched 02:04:42.912875 run osmo-hlr_10.42.42.2(pid=27155): Launched 02:04:43.040120 run osmo-stp_10.42.42.5: Starting osmo-stp 02:04:43.579039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27157): Launched 02:04:43.907665 run osmo-stp_10.42.42.5(pid=27158): Launched 02:04:44.032350 run osmo-msc_10.42.42.6: Starting osmo-msc 02:04:44.598008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27160): Launched 02:04:44.930646 run osmo-msc_10.42.42.6(pid=27161): Launched 02:04:45.115660 run osmo-stp_10.42.42.5(pid=27158): ERR: Terminated: ERROR {rc=1} [trial-2397↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27158)] 02:04:45.257116 run osmo-stp_10.42.42.5(pid=27158): stdout: | (launched: 2022-12-14_02:04:43.846323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:45.393536 run osmo-stp_10.42.42.5(pid=27158): stderr: | [0;m[38;5;43m20221214020444040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020444040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020444040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020444041 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020444041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020444041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020444041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:45.530588 run osmo-stp_10.42.42.5(pid=27158): stdout: | (launched: 2022-12-14_02:04:43.846323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:04:45.660901 run osmo-stp_10.42.42.5(pid=27158): stderr: | [0;m[38;5;43m20221214020444040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214020444040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214020444040 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214020444041 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214020444041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214020444041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214020444041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:04:45.817211 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27158): Process ended prematurely: osmo-stp_10.42.42.5(pid=27158) [trial-2397↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27158)] [trial-2397↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 02:04:45.826107 tst handover.py:18: Test FAILED (6.7 sec) 02:04:45.854239 run osmo-hlr_10.42.42.2(pid=27155): ERR: Terminated: ERROR {rc=237} [trial-2397↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27155)] 02:04:45.912212 run osmo-hlr_10.42.42.2(pid=27155): stdout: | (launched: 2022-12-14_02:04:42.851968) 02:04:45.969192 run osmo-hlr_10.42.42.2(pid=27155): stderr: | [0;m[1;31m20221214020443052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214020443052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214020443052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214020443052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214020443052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214020443052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214020443064 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214020443075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214020443075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214020443075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:04:46.041304 run osmo-msc_10.42.42.6(pid=27161): ERR: Terminated: ERROR {rc=2} [trial-2397↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27161)] 02:04:46.091731 run osmo-msc_10.42.42.6(pid=27161): stdout: | (launched: 2022-12-14_02:04:44.869435) 02:04:46.143919 run osmo-msc_10.42.42.6(pid=27161): stderr: | [0;m[38;5;43m20221214020445191 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214020445191 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff99746cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214020445191 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214020445191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214020445191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214020445192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214020445193 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214020445194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214020445194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214020445194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:04:46.196542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27154): Terminating (SIGTERM) 02:04:46.239217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27157): Terminating (SIGTERM) 02:04:46.282834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27160): Terminating (SIGTERM) 02:04:46.326166 --- ParallelTerminationStrategy: PID 27154 died... 02:04:46.346761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27154): Terminated: ok {rc=0} 02:04:46.394852 --- ParallelTerminationStrategy: PID 27157 died... 02:04:46.415223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27157): Terminated: ok {rc=0} 02:04:46.462089 --- ParallelTerminationStrategy: PID 27160 died... 02:04:46.482347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27160): Terminated: ok {rc=0} 02:04:46.570867 bus /sierra_3: Setting Powered False 02:04:47.668942 bus /sierra_3: Setting Powered False 02:04:48.783406 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2397 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 02:04:50.060680 tst trial-2397: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397/run.2022-12-14_00-40-22/trial-2397.xml -------------------------------------------------------------------------------------------- trial-2397 FAIL -------------------------------------------------------------------------------------------- 02:04:51.999870 tst trial-2397: trial-2397: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.0 sec) Error: osmo-nitb_10.42.42.2(pid=20058): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20058) [trial-2397↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20058)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.1 sec) Error: osmo-stp_10.42.42.5(pid=20068): Process ended prematurely: osmo-stp_10.42.42.5(pid=20068) [trial-2397↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20068)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=20077): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20077) [trial-2397↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20077)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=20088): Process ended prematurely: osmo-stp_10.42.42.5(pid=20088) [trial-2397↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20088)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20102): Process ended prematurely: osmo-stp_10.42.42.5(pid=20102) [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20102)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20113): Process ended prematurely: osmo-stp_10.42.42.5(pid=20113) [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20113)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20127): Process ended prematurely: osmo-stp_10.42.42.5(pid=20127) [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20127)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20138): Process ended prematurely: osmo-stp_10.42.42.5(pid=20138) [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20138)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20152): Process ended prematurely: osmo-stp_10.42.42.5(pid=20152) [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20152)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20163): Process ended prematurely: osmo-stp_10.42.42.5(pid=20163) [trial-2397↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20163)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20177): Process ended prematurely: osmo-stp_10.42.42.5(pid=20177) [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20177)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20188): Process ended prematurely: osmo-stp_10.42.42.5(pid=20188) [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20188)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20202): Process ended prematurely: osmo-stp_10.42.42.5(pid=20202) [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20202)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20213): Process ended prematurely: osmo-stp_10.42.42.5(pid=20213) [trial-2397↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20213)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20230): Process ended prematurely: osmo-stp_10.42.42.5(pid=20230) [trial-2397↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20230)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20241): Process ended prematurely: osmo-stp_10.42.42.5(pid=20241) [trial-2397↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20241)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=20256): Process ended prematurely: osmo-stp_10.42.42.5(pid=20256) [trial-2397↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20256)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20267): Process ended prematurely: osmo-stp_10.42.42.5(pid=20267) [trial-2397↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20267)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20283): Process ended prematurely: osmo-stp_10.42.42.5(pid=20283) [trial-2397↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20283)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20298): Process ended prematurely: osmo-stp_10.42.42.5(pid=20298) [trial-2397↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20298)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.5 sec) Error: osmo-stp_10.42.42.5(pid=20316): Process ended prematurely: osmo-stp_10.42.42.5(pid=20316) [trial-2397↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20316)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=20328): Process ended prematurely: osmo-stp_10.42.42.5(pid=20328) [trial-2397↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20328)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=20346): Process ended prematurely: osmo-stp_10.42.42.5(pid=20346) [trial-2397↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20346)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20356): Process ended prematurely: osmo-stp_10.42.42.5(pid=20356) [trial-2397↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20356)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20366): Process ended prematurely: osmo-stp_10.42.42.5(pid=20366) [trial-2397↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20366)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=20383): Process ended prematurely: osmo-stp_10.42.42.5(pid=20383) [trial-2397↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20383)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=20395): Process ended prematurely: osmo-stp_10.42.42.5(pid=20395) [trial-2397↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20395)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=20414): Process ended prematurely: osmo-stp_10.42.42.5(pid=20414) [trial-2397↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20414)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20424): Process ended prematurely: osmo-stp_10.42.42.5(pid=20424) [trial-2397↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20424)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20434): Process ended prematurely: osmo-stp_10.42.42.5(pid=20434) [trial-2397↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20434)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=20452): Process ended prematurely: osmo-stp_10.42.42.5(pid=20452) [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20452)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=20464): Process ended prematurely: osmo-stp_10.42.42.5(pid=20464) [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20464)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=20482): Process ended prematurely: osmo-stp_10.42.42.5(pid=20482) [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20482)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20492): Process ended prematurely: osmo-stp_10.42.42.5(pid=20492) [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20492)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20502): Process ended prematurely: osmo-stp_10.42.42.5(pid=20502) [trial-2397↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20502)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=20520): Process ended prematurely: osmo-stp_10.42.42.5(pid=20520) [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20520)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=20532): Process ended prematurely: osmo-stp_10.42.42.5(pid=20532) [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20532)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=20550): Process ended prematurely: osmo-stp_10.42.42.5(pid=20550) [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20550)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20560): Process ended prematurely: osmo-stp_10.42.42.5(pid=20560) [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20560)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20573): Process ended prematurely: osmo-stp_10.42.42.5(pid=20573) [trial-2397↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20573)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20586): Process ended prematurely: osmo-stp_10.42.42.5(pid=20586) [trial-2397↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20586)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20600): Process ended prematurely: osmo-stp_10.42.42.5(pid=20600) [trial-2397↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20600)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=20609): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20609) [trial-2397↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20609)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20619): Process ended prematurely: osmo-stp_10.42.42.5(pid=20619) [trial-2397↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20619)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=20630): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20630) [trial-2397↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20630)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20640): Process ended prematurely: osmo-stp_10.42.42.5(pid=20640) [trial-2397↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20640)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20655): Process ended prematurely: osmo-stp_10.42.42.5(pid=20655) [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20655)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20666): Process ended prematurely: osmo-stp_10.42.42.5(pid=20666) [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20666)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20680): Process ended prematurely: osmo-stp_10.42.42.5(pid=20680) [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20680)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20691): Process ended prematurely: osmo-stp_10.42.42.5(pid=20691) [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20691)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20705): Process ended prematurely: osmo-stp_10.42.42.5(pid=20705) [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20705)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20716): Process ended prematurely: osmo-stp_10.42.42.5(pid=20716) [trial-2397↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20716)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20730): Process ended prematurely: osmo-stp_10.42.42.5(pid=20730) [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20730)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20741): Process ended prematurely: osmo-stp_10.42.42.5(pid=20741) [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20741)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20755): Process ended prematurely: osmo-stp_10.42.42.5(pid=20755) [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20755)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20766): Process ended prematurely: osmo-stp_10.42.42.5(pid=20766) [trial-2397↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20766)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20780): Process ended prematurely: osmo-stp_10.42.42.5(pid=20780) [trial-2397↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20780)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20791): Process ended prematurely: osmo-stp_10.42.42.5(pid=20791) [trial-2397↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20791)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20805): Process ended prematurely: osmo-stp_10.42.42.5(pid=20805) [trial-2397↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20805)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20816): Process ended prematurely: osmo-stp_10.42.42.5(pid=20816) [trial-2397↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20816)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20831): Process ended prematurely: osmo-stp_10.42.42.5(pid=20831) [trial-2397↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20831)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20842): Process ended prematurely: osmo-stp_10.42.42.5(pid=20842) [trial-2397↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20842)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (9.9 sec) Error: osmo-stp_10.42.42.5(pid=21131): Process ended prematurely: osmo-stp_10.42.42.5(pid=21131) [trial-2397↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21131)] FAIL: iperf3.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=21143): Process ended prematurely: osmo-stp_10.42.42.5(pid=21143) [trial-2397↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21143)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=21163): Process ended prematurely: osmo-stp_10.42.42.5(pid=21163) [trial-2397↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21163)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21173): Process ended prematurely: osmo-stp_10.42.42.5(pid=21173) [trial-2397↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21173)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21183): Process ended prematurely: osmo-stp_10.42.42.5(pid=21183) [trial-2397↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21183)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=21203): Process ended prematurely: osmo-stp_10.42.42.5(pid=21203) [trial-2397↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21203)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=21215): Process ended prematurely: osmo-stp_10.42.42.5(pid=21215) [trial-2397↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21215)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=21233): Process ended prematurely: osmo-stp_10.42.42.5(pid=21233) [trial-2397↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21233)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21246): Process ended prematurely: osmo-stp_10.42.42.5(pid=21246) [trial-2397↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21246)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21256): Process ended prematurely: osmo-stp_10.42.42.5(pid=21256) [trial-2397↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21256)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21274): Process ended prematurely: osmo-stp_10.42.42.5(pid=21274) [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21274)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=21286): Process ended prematurely: osmo-stp_10.42.42.5(pid=21286) [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21286)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=21304): Process ended prematurely: osmo-stp_10.42.42.5(pid=21304) [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21304)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21314): Process ended prematurely: osmo-stp_10.42.42.5(pid=21314) [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21314)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21324): Process ended prematurely: osmo-stp_10.42.42.5(pid=21324) [trial-2397↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21324)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=21342): Process ended prematurely: osmo-stp_10.42.42.5(pid=21342) [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21342)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=21354): Process ended prematurely: osmo-stp_10.42.42.5(pid=21354) [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21354)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=21373): Process ended prematurely: osmo-stp_10.42.42.5(pid=21373) [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21373)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21383): Process ended prematurely: osmo-stp_10.42.42.5(pid=21383) [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21383)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21393): Process ended prematurely: osmo-stp_10.42.42.5(pid=21393) [trial-2397↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21393)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21407): Process ended prematurely: osmo-stp_10.42.42.5(pid=21407) [trial-2397↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21407)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21420): Process ended prematurely: osmo-stp_10.42.42.5(pid=21420) [trial-2397↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21420)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=21428): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21428) [trial-2397↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21428)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=21438): Process ended prematurely: osmo-stp_10.42.42.5(pid=21438) [trial-2397↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21438)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=21447): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21447) [trial-2397↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21447)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21457): Process ended prematurely: osmo-stp_10.42.42.5(pid=21457) [trial-2397↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21457)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21471): Process ended prematurely: osmo-stp_10.42.42.5(pid=21471) [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21471)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21482): Process ended prematurely: osmo-stp_10.42.42.5(pid=21482) [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21482)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21496): Process ended prematurely: osmo-stp_10.42.42.5(pid=21496) [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21496)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21507): Process ended prematurely: osmo-stp_10.42.42.5(pid=21507) [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21507)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21522): Process ended prematurely: osmo-stp_10.42.42.5(pid=21522) [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21522)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21533): Process ended prematurely: osmo-stp_10.42.42.5(pid=21533) [trial-2397↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21533)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21550): Process ended prematurely: osmo-stp_10.42.42.5(pid=21550) [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21550)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21561): Process ended prematurely: osmo-stp_10.42.42.5(pid=21561) [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21561)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21577): Process ended prematurely: osmo-stp_10.42.42.5(pid=21577) [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21577)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21588): Process ended prematurely: osmo-stp_10.42.42.5(pid=21588) [trial-2397↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21588)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21603): Process ended prematurely: osmo-stp_10.42.42.5(pid=21603) [trial-2397↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21603)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21614): Process ended prematurely: osmo-stp_10.42.42.5(pid=21614) [trial-2397↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21614)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21628): Process ended prematurely: osmo-stp_10.42.42.5(pid=21628) [trial-2397↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21628)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21639): Process ended prematurely: osmo-stp_10.42.42.5(pid=21639) [trial-2397↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21639)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=21653): Process ended prematurely: osmo-stp_10.42.42.5(pid=21653) [trial-2397↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21653)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21664): Process ended prematurely: osmo-stp_10.42.42.5(pid=21664) [trial-2397↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21664)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=21678): Process ended prematurely: osmo-stp_10.42.42.5(pid=21678) [trial-2397↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21678)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21689): Process ended prematurely: osmo-stp_10.42.42.5(pid=21689) [trial-2397↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21689)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21704): Process ended prematurely: osmo-stp_10.42.42.5(pid=21704) [trial-2397↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21704)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21715): Process ended prematurely: osmo-stp_10.42.42.5(pid=21715) [trial-2397↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21715)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=21733): Process ended prematurely: osmo-stp_10.42.42.5(pid=21733) [trial-2397↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21733)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=21745): Process ended prematurely: osmo-stp_10.42.42.5(pid=21745) [trial-2397↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21745)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=21764): Process ended prematurely: osmo-stp_10.42.42.5(pid=21764) [trial-2397↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21764)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21774): Process ended prematurely: osmo-stp_10.42.42.5(pid=21774) [trial-2397↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21774)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21784): Process ended prematurely: osmo-stp_10.42.42.5(pid=21784) [trial-2397↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21784)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=21801): Process ended prematurely: osmo-stp_10.42.42.5(pid=21801) [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21801)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=21813): Process ended prematurely: osmo-stp_10.42.42.5(pid=21813) [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21813)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=21831): Process ended prematurely: osmo-stp_10.42.42.5(pid=21831) [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21831)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21841): Process ended prematurely: osmo-stp_10.42.42.5(pid=21841) [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21841)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21851): Process ended prematurely: osmo-stp_10.42.42.5(pid=21851) [trial-2397↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21851)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=21869): Process ended prematurely: osmo-stp_10.42.42.5(pid=21869) [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21869)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=21881): Process ended prematurely: osmo-stp_10.42.42.5(pid=21881) [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21881)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=21902): Process ended prematurely: osmo-stp_10.42.42.5(pid=21902) [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21902)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21912): Process ended prematurely: osmo-stp_10.42.42.5(pid=21912) [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21912)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21922): Process ended prematurely: osmo-stp_10.42.42.5(pid=21922) [trial-2397↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21922)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21940): Process ended prematurely: osmo-stp_10.42.42.5(pid=21940) [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21940)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=21952): Process ended prematurely: osmo-stp_10.42.42.5(pid=21952) [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21952)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=21971): Process ended prematurely: osmo-stp_10.42.42.5(pid=21971) [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21971)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21981): Process ended prematurely: osmo-stp_10.42.42.5(pid=21981) [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21981)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21991): Process ended prematurely: osmo-stp_10.42.42.5(pid=21991) [trial-2397↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21991)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=22008): Process ended prematurely: osmo-stp_10.42.42.5(pid=22008) [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22008)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=22020): Process ended prematurely: osmo-stp_10.42.42.5(pid=22020) [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22020)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=22038): Process ended prematurely: osmo-stp_10.42.42.5(pid=22038) [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22038)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22048): Process ended prematurely: osmo-stp_10.42.42.5(pid=22048) [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22048)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22058): Process ended prematurely: osmo-stp_10.42.42.5(pid=22058) [trial-2397↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22058)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22071): Process ended prematurely: osmo-stp_10.42.42.5(pid=22071) [trial-2397↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22071)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22084): Process ended prematurely: osmo-stp_10.42.42.5(pid=22084) [trial-2397↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22084)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=22092): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22092) [trial-2397↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22092)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22104): Process ended prematurely: osmo-stp_10.42.42.5(pid=22104) [trial-2397↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22104)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=22113): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22113) [trial-2397↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22113)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22123): Process ended prematurely: osmo-stp_10.42.42.5(pid=22123) [trial-2397↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22123)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22137): Process ended prematurely: osmo-stp_10.42.42.5(pid=22137) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22137)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22148): Process ended prematurely: osmo-stp_10.42.42.5(pid=22148) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22148)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=22198): Process ended prematurely: osmo-stp_10.42.42.5(pid=22198) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22198)] FAIL: mo_mt_call_osmux.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=22445): Process ended prematurely: osmo-stp_10.42.42.5(pid=22445) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22445)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=22459): Process ended prematurely: osmo-stp_10.42.42.5(pid=22459) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22459)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22472): Process ended prematurely: osmo-stp_10.42.42.5(pid=22472) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22472)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22486): Process ended prematurely: osmo-stp_10.42.42.5(pid=22486) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22486)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22497): Process ended prematurely: osmo-stp_10.42.42.5(pid=22497) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22497)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22515): Process ended prematurely: osmo-stp_10.42.42.5(pid=22515) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22515)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22526): Process ended prematurely: osmo-stp_10.42.42.5(pid=22526) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22526)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22540): Process ended prematurely: osmo-stp_10.42.42.5(pid=22540) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22540)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22551): Process ended prematurely: osmo-stp_10.42.42.5(pid=22551) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22551)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22568): Process ended prematurely: osmo-stp_10.42.42.5(pid=22568) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22568)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22579): Process ended prematurely: osmo-stp_10.42.42.5(pid=22579) [trial-2397↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22579)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22593): Process ended prematurely: osmo-stp_10.42.42.5(pid=22593) [trial-2397↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22593)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22604): Process ended prematurely: osmo-stp_10.42.42.5(pid=22604) [trial-2397↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22604)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=22622): Process ended prematurely: osmo-stp_10.42.42.5(pid=22622) [trial-2397↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22622)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=22634): Process ended prematurely: osmo-stp_10.42.42.5(pid=22634) [trial-2397↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22634)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=22652): Process ended prematurely: osmo-stp_10.42.42.5(pid=22652) [trial-2397↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22652)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22663): Process ended prematurely: osmo-stp_10.42.42.5(pid=22663) [trial-2397↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22663)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=22673): Process ended prematurely: osmo-stp_10.42.42.5(pid=22673) [trial-2397↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22673)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=22690): Process ended prematurely: osmo-stp_10.42.42.5(pid=22690) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22690)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=22702): Process ended prematurely: osmo-stp_10.42.42.5(pid=22702) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22702)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=22720): Process ended prematurely: osmo-stp_10.42.42.5(pid=22720) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22720)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22730): Process ended prematurely: osmo-stp_10.42.42.5(pid=22730) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22730)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=22740): Process ended prematurely: osmo-stp_10.42.42.5(pid=22740) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22740)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=22757): Process ended prematurely: osmo-stp_10.42.42.5(pid=22757) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22757)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=22769): Process ended prematurely: osmo-stp_10.42.42.5(pid=22769) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22769)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=22787): Process ended prematurely: osmo-stp_10.42.42.5(pid=22787) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22787)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22798): Process ended prematurely: osmo-stp_10.42.42.5(pid=22798) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22798)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=22808): Process ended prematurely: osmo-stp_10.42.42.5(pid=22808) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22808)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=22826): Process ended prematurely: osmo-stp_10.42.42.5(pid=22826) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22826)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=22838): Process ended prematurely: osmo-stp_10.42.42.5(pid=22838) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22838)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=22859): Process ended prematurely: osmo-stp_10.42.42.5(pid=22859) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22859)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22870): Process ended prematurely: osmo-stp_10.42.42.5(pid=22870) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22870)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22880): Process ended prematurely: osmo-stp_10.42.42.5(pid=22880) [trial-2397↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22880)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=22893): Process ended prematurely: osmo-stp_10.42.42.5(pid=22893) [trial-2397↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22893)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22910): Process ended prematurely: osmo-stp_10.42.42.5(pid=22910) [trial-2397↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22910)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=22918): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22918) [trial-2397↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22918)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=22928): Process ended prematurely: osmo-stp_10.42.42.5(pid=22928) [trial-2397↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22928)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=22937): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22937) [trial-2397↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22937)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22947): Process ended prematurely: osmo-stp_10.42.42.5(pid=22947) [trial-2397↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22947)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=22961): Process ended prematurely: osmo-stp_10.42.42.5(pid=22961) [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22961)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22972): Process ended prematurely: osmo-stp_10.42.42.5(pid=22972) [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22972)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22986): Process ended prematurely: osmo-stp_10.42.42.5(pid=22986) [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22986)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23000): Process ended prematurely: osmo-stp_10.42.42.5(pid=23000) [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23000)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23014): Process ended prematurely: osmo-stp_10.42.42.5(pid=23014) [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23014)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23025): Process ended prematurely: osmo-stp_10.42.42.5(pid=23025) [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23025)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23040): Process ended prematurely: osmo-stp_10.42.42.5(pid=23040) [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23040)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23051): Process ended prematurely: osmo-stp_10.42.42.5(pid=23051) [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23051)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23065): Process ended prematurely: osmo-stp_10.42.42.5(pid=23065) [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23065)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23076): Process ended prematurely: osmo-stp_10.42.42.5(pid=23076) [trial-2397↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23076)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23090): Process ended prematurely: osmo-stp_10.42.42.5(pid=23090) [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23090)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=23101): Process ended prematurely: osmo-stp_10.42.42.5(pid=23101) [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23101)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23117): Process ended prematurely: osmo-stp_10.42.42.5(pid=23117) [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23117)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23128): Process ended prematurely: osmo-stp_10.42.42.5(pid=23128) [trial-2397↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23128)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=23142): Process ended prematurely: osmo-stp_10.42.42.5(pid=23142) [trial-2397↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23142)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23153): Process ended prematurely: osmo-stp_10.42.42.5(pid=23153) [trial-2397↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23153)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23168): Process ended prematurely: osmo-stp_10.42.42.5(pid=23168) [trial-2397↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23168)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23179): Process ended prematurely: osmo-stp_10.42.42.5(pid=23179) [trial-2397↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23179)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=23198): Process ended prematurely: osmo-stp_10.42.42.5(pid=23198) [trial-2397↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23198)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=23213): Process ended prematurely: osmo-stp_10.42.42.5(pid=23213) [trial-2397↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23213)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=23231): Process ended prematurely: osmo-stp_10.42.42.5(pid=23231) [trial-2397↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23231)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23241): Process ended prematurely: osmo-stp_10.42.42.5(pid=23241) [trial-2397↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23241)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23251): Process ended prematurely: osmo-stp_10.42.42.5(pid=23251) [trial-2397↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23251)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=23269): Process ended prematurely: osmo-stp_10.42.42.5(pid=23269) [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23269)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=23281): Process ended prematurely: osmo-stp_10.42.42.5(pid=23281) [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23281)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=23299): Process ended prematurely: osmo-stp_10.42.42.5(pid=23299) [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23299)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23309): Process ended prematurely: osmo-stp_10.42.42.5(pid=23309) [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23309)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23319): Process ended prematurely: osmo-stp_10.42.42.5(pid=23319) [trial-2397↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23319)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=23336): Process ended prematurely: osmo-stp_10.42.42.5(pid=23336) [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23336)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=23348): Process ended prematurely: osmo-stp_10.42.42.5(pid=23348) [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23348)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=23367): Process ended prematurely: osmo-stp_10.42.42.5(pid=23367) [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23367)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23377): Process ended prematurely: osmo-stp_10.42.42.5(pid=23377) [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23377)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23387): Process ended prematurely: osmo-stp_10.42.42.5(pid=23387) [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23387)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=23405): Process ended prematurely: osmo-stp_10.42.42.5(pid=23405) [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23405)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=23417): Process ended prematurely: osmo-stp_10.42.42.5(pid=23417) [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23417)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=23435): Process ended prematurely: osmo-stp_10.42.42.5(pid=23435) [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23435)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23445): Process ended prematurely: osmo-stp_10.42.42.5(pid=23445) [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23445)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23455): Process ended prematurely: osmo-stp_10.42.42.5(pid=23455) [trial-2397↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23455)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=23479): Process ended prematurely: osmo-stp_10.42.42.5(pid=23479) [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23479)] FAIL: iperf3.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=23762): Process ended prematurely: osmo-stp_10.42.42.5(pid=23762) [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23762)] FAIL: iperf3m4.py (12.0 sec) Error: osmo-stp_10.42.42.5(pid=23780): Process ended prematurely: osmo-stp_10.42.42.5(pid=23780) [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23780)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23791): Process ended prematurely: osmo-stp_10.42.42.5(pid=23791) [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23791)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=23801): Process ended prematurely: osmo-stp_10.42.42.5(pid=23801) [trial-2397↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23801)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23816): Process ended prematurely: osmo-stp_10.42.42.5(pid=23816) [trial-2397↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23816)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23833): Process ended prematurely: osmo-stp_10.42.42.5(pid=23833) [trial-2397↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23833)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=23841): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23841) [trial-2397↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23841)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=23851): Process ended prematurely: osmo-stp_10.42.42.5(pid=23851) [trial-2397↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23851)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=23860): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23860) [trial-2397↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23860)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=23870): Process ended prematurely: osmo-stp_10.42.42.5(pid=23870) [trial-2397↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23870)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23884): Process ended prematurely: osmo-stp_10.42.42.5(pid=23884) [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23884)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23896): Process ended prematurely: osmo-stp_10.42.42.5(pid=23896) [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23896)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23910): Process ended prematurely: osmo-stp_10.42.42.5(pid=23910) [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23910)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23921): Process ended prematurely: osmo-stp_10.42.42.5(pid=23921) [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23921)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23935): Process ended prematurely: osmo-stp_10.42.42.5(pid=23935) [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23935)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23946): Process ended prematurely: osmo-stp_10.42.42.5(pid=23946) [trial-2397↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23946)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23960): Process ended prematurely: osmo-stp_10.42.42.5(pid=23960) [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23960)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23971): Process ended prematurely: osmo-stp_10.42.42.5(pid=23971) [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23971)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23985): Process ended prematurely: osmo-stp_10.42.42.5(pid=23985) [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23985)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23996): Process ended prematurely: osmo-stp_10.42.42.5(pid=23996) [trial-2397↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23996)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24010): Process ended prematurely: osmo-stp_10.42.42.5(pid=24010) [trial-2397↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24010)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24021): Process ended prematurely: osmo-stp_10.42.42.5(pid=24021) [trial-2397↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24021)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24036): Process ended prematurely: osmo-stp_10.42.42.5(pid=24036) [trial-2397↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24036)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24047): Process ended prematurely: osmo-stp_10.42.42.5(pid=24047) [trial-2397↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24047)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24061): Process ended prematurely: osmo-stp_10.42.42.5(pid=24061) [trial-2397↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24061)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24072): Process ended prematurely: osmo-stp_10.42.42.5(pid=24072) [trial-2397↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24072)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=24090): Process ended prematurely: osmo-stp_10.42.42.5(pid=24090) [trial-2397↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24090)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=24102): Process ended prematurely: osmo-stp_10.42.42.5(pid=24102) [trial-2397↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24102)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=24120): Process ended prematurely: osmo-stp_10.42.42.5(pid=24120) [trial-2397↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24120)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24130): Process ended prematurely: osmo-stp_10.42.42.5(pid=24130) [trial-2397↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24130)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24141): Process ended prematurely: osmo-stp_10.42.42.5(pid=24141) [trial-2397↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24141)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=24159): Process ended prematurely: osmo-stp_10.42.42.5(pid=24159) [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24159)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=24174): Process ended prematurely: osmo-stp_10.42.42.5(pid=24174) [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24174)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=24192): Process ended prematurely: osmo-stp_10.42.42.5(pid=24192) [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24192)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=24202): Process ended prematurely: osmo-stp_10.42.42.5(pid=24202) [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24202)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24212): Process ended prematurely: osmo-stp_10.42.42.5(pid=24212) [trial-2397↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24212)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=24231): Process ended prematurely: osmo-stp_10.42.42.5(pid=24231) [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24231)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=24244): Process ended prematurely: osmo-stp_10.42.42.5(pid=24244) [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24244)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=24262): Process ended prematurely: osmo-stp_10.42.42.5(pid=24262) [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24262)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24272): Process ended prematurely: osmo-stp_10.42.42.5(pid=24272) [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24272)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24282): Process ended prematurely: osmo-stp_10.42.42.5(pid=24282) [trial-2397↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24282)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=24300): Process ended prematurely: osmo-stp_10.42.42.5(pid=24300) [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24300)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=24312): Process ended prematurely: osmo-stp_10.42.42.5(pid=24312) [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24312)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=24330): Process ended prematurely: osmo-stp_10.42.42.5(pid=24330) [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24330)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24340): Process ended prematurely: osmo-stp_10.42.42.5(pid=24340) [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24340)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24350): Process ended prematurely: osmo-stp_10.42.42.5(pid=24350) [trial-2397↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24350)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24365): Process ended prematurely: osmo-stp_10.42.42.5(pid=24365) [trial-2397↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24365)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24381): Process ended prematurely: osmo-stp_10.42.42.5(pid=24381) [trial-2397↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24381)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=24389): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24389) [trial-2397↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24389)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24399): Process ended prematurely: osmo-stp_10.42.42.5(pid=24399) [trial-2397↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24399)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=24408): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24408) [trial-2397↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24408)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=24418): Process ended prematurely: osmo-stp_10.42.42.5(pid=24418) [trial-2397↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24418)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24432): Process ended prematurely: osmo-stp_10.42.42.5(pid=24432) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24432)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24443): Process ended prematurely: osmo-stp_10.42.42.5(pid=24443) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24443)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24457): Process ended prematurely: osmo-stp_10.42.42.5(pid=24457) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24457)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24468): Process ended prematurely: osmo-stp_10.42.42.5(pid=24468) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24468)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24482): Process ended prematurely: osmo-stp_10.42.42.5(pid=24482) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24482)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24493): Process ended prematurely: osmo-stp_10.42.42.5(pid=24493) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24493)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24508): Process ended prematurely: osmo-stp_10.42.42.5(pid=24508) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24508)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24519): Process ended prematurely: osmo-stp_10.42.42.5(pid=24519) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24519)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=24536): Process ended prematurely: osmo-stp_10.42.42.5(pid=24536) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24536)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24547): Process ended prematurely: osmo-stp_10.42.42.5(pid=24547) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24547)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24562): Process ended prematurely: osmo-stp_10.42.42.5(pid=24562) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24562)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24573): Process ended prematurely: osmo-stp_10.42.42.5(pid=24573) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24573)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=24589): Process ended prematurely: osmo-stp_10.42.42.5(pid=24589) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24589)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24600): Process ended prematurely: osmo-stp_10.42.42.5(pid=24600) [trial-2397↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24600)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24615): Process ended prematurely: osmo-stp_10.42.42.5(pid=24615) [trial-2397↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24615)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24626): Process ended prematurely: osmo-stp_10.42.42.5(pid=24626) [trial-2397↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24626)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=24644): Process ended prematurely: osmo-stp_10.42.42.5(pid=24644) [trial-2397↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24644)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=24656): Process ended prematurely: osmo-stp_10.42.42.5(pid=24656) [trial-2397↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24656)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=24674): Process ended prematurely: osmo-stp_10.42.42.5(pid=24674) [trial-2397↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24674)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24684): Process ended prematurely: osmo-stp_10.42.42.5(pid=24684) [trial-2397↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24684)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24694): Process ended prematurely: osmo-stp_10.42.42.5(pid=24694) [trial-2397↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24694)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=24711): Process ended prematurely: osmo-stp_10.42.42.5(pid=24711) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24711)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=24723): Process ended prematurely: osmo-stp_10.42.42.5(pid=24723) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24723)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=24741): Process ended prematurely: osmo-stp_10.42.42.5(pid=24741) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24741)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24751): Process ended prematurely: osmo-stp_10.42.42.5(pid=24751) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24751)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24761): Process ended prematurely: osmo-stp_10.42.42.5(pid=24761) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24761)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=24778): Process ended prematurely: osmo-stp_10.42.42.5(pid=24778) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24778)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=24790): Process ended prematurely: osmo-stp_10.42.42.5(pid=24790) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24790)] FAIL: iperf3m4.py (11.8 sec) Error: osmo-stp_10.42.42.5(pid=25080): Process ended prematurely: osmo-stp_10.42.42.5(pid=25080) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25080)] FAIL: ping.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=25090): Process ended prematurely: osmo-stp_10.42.42.5(pid=25090) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25090)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25101): Process ended prematurely: osmo-stp_10.42.42.5(pid=25101) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25101)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=25118): Process ended prematurely: osmo-stp_10.42.42.5(pid=25118) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25118)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=25130): Process ended prematurely: osmo-stp_10.42.42.5(pid=25130) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25130)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=25151): Process ended prematurely: osmo-stp_10.42.42.5(pid=25151) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25151)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25161): Process ended prematurely: osmo-stp_10.42.42.5(pid=25161) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25161)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=25171): Process ended prematurely: osmo-stp_10.42.42.5(pid=25171) [trial-2397↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25171)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25185): Process ended prematurely: osmo-stp_10.42.42.5(pid=25185) [trial-2397↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25185)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25200): Process ended prematurely: osmo-stp_10.42.42.5(pid=25200) [trial-2397↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25200)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=25208): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25208) [trial-2397↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25208)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=25218): Process ended prematurely: osmo-stp_10.42.42.5(pid=25218) [trial-2397↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25218)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=25227): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25227) [trial-2397↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25227)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=25237): Process ended prematurely: osmo-stp_10.42.42.5(pid=25237) [trial-2397↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25237)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25251): Process ended prematurely: osmo-stp_10.42.42.5(pid=25251) [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25251)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25262): Process ended prematurely: osmo-stp_10.42.42.5(pid=25262) [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25262)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25277): Process ended prematurely: osmo-stp_10.42.42.5(pid=25277) [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25277)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25294): Process ended prematurely: osmo-stp_10.42.42.5(pid=25294) [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25294)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25308): Process ended prematurely: osmo-stp_10.42.42.5(pid=25308) [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25308)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25319): Process ended prematurely: osmo-stp_10.42.42.5(pid=25319) [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25319)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25334): Process ended prematurely: osmo-stp_10.42.42.5(pid=25334) [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25334)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25345): Process ended prematurely: osmo-stp_10.42.42.5(pid=25345) [trial-2397↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25345)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25359): Process ended prematurely: osmo-stp_10.42.42.5(pid=25359) [trial-2397↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25359)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25370): Process ended prematurely: osmo-stp_10.42.42.5(pid=25370) [trial-2397↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25370)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25384): Process ended prematurely: osmo-stp_10.42.42.5(pid=25384) [trial-2397↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25384)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25395): Process ended prematurely: osmo-stp_10.42.42.5(pid=25395) [trial-2397↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25395)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=25413): Process ended prematurely: osmo-stp_10.42.42.5(pid=25413) [trial-2397↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25413)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=25425): Process ended prematurely: osmo-stp_10.42.42.5(pid=25425) [trial-2397↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25425)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=25443): Process ended prematurely: osmo-stp_10.42.42.5(pid=25443) [trial-2397↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25443)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=25453): Process ended prematurely: osmo-stp_10.42.42.5(pid=25453) [trial-2397↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25453)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25464): Process ended prematurely: osmo-stp_10.42.42.5(pid=25464) [trial-2397↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25464)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=25481): Process ended prematurely: osmo-stp_10.42.42.5(pid=25481) [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25481)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=25497): Process ended prematurely: osmo-stp_10.42.42.5(pid=25497) [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25497)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=25515): Process ended prematurely: osmo-stp_10.42.42.5(pid=25515) [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25515)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25525): Process ended prematurely: osmo-stp_10.42.42.5(pid=25525) [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25525)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25535): Process ended prematurely: osmo-stp_10.42.42.5(pid=25535) [trial-2397↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25535)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=25552): Process ended prematurely: osmo-stp_10.42.42.5(pid=25552) [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25552)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=25566): Process ended prematurely: osmo-stp_10.42.42.5(pid=25566) [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25566)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=25584): Process ended prematurely: osmo-stp_10.42.42.5(pid=25584) [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25584)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25594): Process ended prematurely: osmo-stp_10.42.42.5(pid=25594) [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25594)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25604): Process ended prematurely: osmo-stp_10.42.42.5(pid=25604) [trial-2397↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25604)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25617): Process ended prematurely: osmo-stp_10.42.42.5(pid=25617) [trial-2397↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25617)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25630): Process ended prematurely: osmo-stp_10.42.42.5(pid=25630) [trial-2397↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25630)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=25639): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25639) [trial-2397↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25639)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25649): Process ended prematurely: osmo-stp_10.42.42.5(pid=25649) [trial-2397↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25649)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25664): Process ended prematurely: osmo-stp_10.42.42.5(pid=25664) [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25664)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25675): Process ended prematurely: osmo-stp_10.42.42.5(pid=25675) [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25675)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25689): Process ended prematurely: osmo-stp_10.42.42.5(pid=25689) [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25689)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25700): Process ended prematurely: osmo-stp_10.42.42.5(pid=25700) [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25700)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25714): Process ended prematurely: osmo-stp_10.42.42.5(pid=25714) [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25714)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25725): Process ended prematurely: osmo-stp_10.42.42.5(pid=25725) [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25725)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25739): Process ended prematurely: osmo-stp_10.42.42.5(pid=25739) [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25739)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25750): Process ended prematurely: osmo-stp_10.42.42.5(pid=25750) [trial-2397↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25750)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25766): Process ended prematurely: osmo-stp_10.42.42.5(pid=25766) [trial-2397↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25766)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25777): Process ended prematurely: osmo-stp_10.42.42.5(pid=25777) [trial-2397↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25777)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25792): Process ended prematurely: osmo-stp_10.42.42.5(pid=25792) [trial-2397↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25792)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25803): Process ended prematurely: osmo-stp_10.42.42.5(pid=25803) [trial-2397↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25803)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25817): Process ended prematurely: osmo-stp_10.42.42.5(pid=25817) [trial-2397↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25817)] FAIL: emergency_preemptive_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=25829): Process ended prematurely: osmo-stp_10.42.42.5(pid=25829) [trial-2397↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25829)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=25850): Process ended prematurely: osmo-stp_10.42.42.5(pid=25850) [trial-2397↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25850)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=25862): Process ended prematurely: osmo-stp_10.42.42.5(pid=25862) [trial-2397↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25862)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=25880): Process ended prematurely: osmo-stp_10.42.42.5(pid=25880) [trial-2397↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25880)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25890): Process ended prematurely: osmo-stp_10.42.42.5(pid=25890) [trial-2397↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25890)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25904): Process ended prematurely: osmo-stp_10.42.42.5(pid=25904) [trial-2397↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25904)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=25922): Process ended prematurely: osmo-stp_10.42.42.5(pid=25922) [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25922)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=25934): Process ended prematurely: osmo-stp_10.42.42.5(pid=25934) [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25934)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=25952): Process ended prematurely: osmo-stp_10.42.42.5(pid=25952) [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25952)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25962): Process ended prematurely: osmo-stp_10.42.42.5(pid=25962) [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25962)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25972): Process ended prematurely: osmo-stp_10.42.42.5(pid=25972) [trial-2397↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25972)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=25989): Process ended prematurely: osmo-stp_10.42.42.5(pid=25989) [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25989)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=26001): Process ended prematurely: osmo-stp_10.42.42.5(pid=26001) [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26001)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=26019): Process ended prematurely: osmo-stp_10.42.42.5(pid=26019) [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26019)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26029): Process ended prematurely: osmo-stp_10.42.42.5(pid=26029) [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26029)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26039): Process ended prematurely: osmo-stp_10.42.42.5(pid=26039) [trial-2397↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26039)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=26056): Process ended prematurely: osmo-stp_10.42.42.5(pid=26056) [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26056)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=26069): Process ended prematurely: osmo-stp_10.42.42.5(pid=26069) [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26069)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=26087): Process ended prematurely: osmo-stp_10.42.42.5(pid=26087) [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26087)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26097): Process ended prematurely: osmo-stp_10.42.42.5(pid=26097) [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26097)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26108): Process ended prematurely: osmo-stp_10.42.42.5(pid=26108) [trial-2397↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26108)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=26131): Process ended prematurely: osmo-stp_10.42.42.5(pid=26131) [trial-2397↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26131)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=26424): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26424) [trial-2397↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26424)] FAIL: esme_connect_policy_closed.py (2.0 sec) Error: osmo-nitb_10.42.42.2(pid=26426): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26426) [trial-2397↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26426)] FAIL: esme_ms_sms_storeforward.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=26428): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26428) [trial-2397↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26428)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=26430): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26430) [trial-2397↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26430)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.6 sec) Error: osmo-hlr_10.42.42.2(pid=26440): Process ended prematurely: osmo-hlr_10.42.42.2(pid=26440) [trial-2397↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26440)] FAIL: esme_connect_policy_closed.py (6.3 sec) Error: osmo-hlr_10.42.42.2(pid=26451): Process ended prematurely: osmo-hlr_10.42.42.2(pid=26451) [trial-2397↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26451)] FAIL: esme_ms_sms_storeforward.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26463): Process ended prematurely: osmo-stp_10.42.42.5(pid=26463) [trial-2397↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26463)] FAIL: esme_ms_sms_transaction.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26474): Process ended prematurely: osmo-stp_10.42.42.5(pid=26474) [trial-2397↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26474)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26489): Process ended prematurely: osmo-stp_10.42.42.5(pid=26489) [trial-2397↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26489)] FAIL: register_a5_0_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26503): Process ended prematurely: osmo-stp_10.42.42.5(pid=26503) [trial-2397↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26503)] FAIL: register_a5_1_authreq.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=26514): Process ended prematurely: osmo-stp_10.42.42.5(pid=26514) [trial-2397↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26514)] FAIL: register_a5_3_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26525): Process ended prematurely: osmo-stp_10.42.42.5(pid=26525) [trial-2397↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26525)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.3 sec) Error: srsepc(pid=26545): Process ended prematurely: srsepc(pid=26545) [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26545)] FAIL: iperf3_bidir.py (18.9 sec) Error: srsepc(pid=26562): Process ended prematurely: srsepc(pid=26562) [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26562)] FAIL: iperf3_dl.py (19.0 sec) Error: srsepc(pid=26578): Process ended prematurely: srsepc(pid=26578) [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26578)] FAIL: iperf3_ul.py (18.8 sec) Error: srsepc(pid=26594): Process ended prematurely: srsepc(pid=26594) [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26594)] FAIL: ping.py (18.7 sec) Error: srsepc(pid=26610): Process ended prematurely: srsepc(pid=26610) [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26610)] FAIL: rrc_idle_mo_ping.py (18.3 sec) Error: srsepc(pid=26626): Process ended prematurely: srsepc(pid=26626) [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26626)] FAIL: rrc_idle_mt_ping.py (18.3 sec) Error: srsepc(pid=26642): Process ended prematurely: srsepc(pid=26642) [trial-2397↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=26642)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26655): Process ended prematurely: osmo-stp_10.42.42.5(pid=26655) [trial-2397↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26655)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26669): Process ended prematurely: osmo-stp_10.42.42.5(pid=26669) [trial-2397↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26669)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26684): Process ended prematurely: osmo-stp_10.42.42.5(pid=26684) [trial-2397↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26684)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=26699): Process ended prematurely: osmo-stp_10.42.42.5(pid=26699) [trial-2397↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26699)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26713): Process ended prematurely: osmo-stp_10.42.42.5(pid=26713) [trial-2397↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26713)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26727): Process ended prematurely: osmo-stp_10.42.42.5(pid=26727) [trial-2397↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26727)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26741): Process ended prematurely: osmo-stp_10.42.42.5(pid=26741) [trial-2397↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26741)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26755): Process ended prematurely: osmo-stp_10.42.42.5(pid=26755) [trial-2397↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26755)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26769): Process ended prematurely: osmo-stp_10.42.42.5(pid=26769) [trial-2397↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26769)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26784): Process ended prematurely: osmo-stp_10.42.42.5(pid=26784) [trial-2397↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26784)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26798): Process ended prematurely: osmo-stp_10.42.42.5(pid=26798) [trial-2397↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26798)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26815): Process ended prematurely: osmo-stp_10.42.42.5(pid=26815) [trial-2397↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26815)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=26829): Process ended prematurely: osmo-stp_10.42.42.5(pid=26829) [trial-2397↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26829)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26843): Process ended prematurely: osmo-stp_10.42.42.5(pid=26843) [trial-2397↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26843)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26857): Process ended prematurely: osmo-stp_10.42.42.5(pid=26857) [trial-2397↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26857)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26871): Process ended prematurely: osmo-stp_10.42.42.5(pid=26871) [trial-2397↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26871)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=26889): Process ended prematurely: osmo-stp_10.42.42.5(pid=26889) [trial-2397↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26889)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26903): Process ended prematurely: osmo-stp_10.42.42.5(pid=26903) [trial-2397↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26903)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26917): Process ended prematurely: osmo-stp_10.42.42.5(pid=26917) [trial-2397↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26917)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26931): Process ended prematurely: osmo-stp_10.42.42.5(pid=26931) [trial-2397↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26931)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26945): Process ended prematurely: osmo-stp_10.42.42.5(pid=26945) [trial-2397↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26945)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=26960): Process ended prematurely: osmo-stp_10.42.42.5(pid=26960) [trial-2397↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26960)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26975): Process ended prematurely: osmo-stp_10.42.42.5(pid=26975) [trial-2397↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26975)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26989): Process ended prematurely: osmo-stp_10.42.42.5(pid=26989) [trial-2397↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26989)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27003): Process ended prematurely: osmo-stp_10.42.42.5(pid=27003) [trial-2397↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27003)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=27017): Process ended prematurely: osmo-stp_10.42.42.5(pid=27017) [trial-2397↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27017)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27031): Process ended prematurely: osmo-stp_10.42.42.5(pid=27031) [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27031)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27046): Process ended prematurely: osmo-stp_10.42.42.5(pid=27046) [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27046)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27060): Process ended prematurely: osmo-stp_10.42.42.5(pid=27060) [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27060)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27074): Process ended prematurely: osmo-stp_10.42.42.5(pid=27074) [trial-2397↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27074)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=27088): Process ended prematurely: osmo-stp_10.42.42.5(pid=27088) [trial-2397↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27088)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27102): Process ended prematurely: osmo-stp_10.42.42.5(pid=27102) [trial-2397↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27102)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27116): Process ended prematurely: osmo-stp_10.42.42.5(pid=27116) [trial-2397↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27116)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27130): Process ended prematurely: osmo-stp_10.42.42.5(pid=27130) [trial-2397↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27130)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27144): Process ended prematurely: osmo-stp_10.42.42.5(pid=27144) [trial-2397↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27144)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27158): Process ended prematurely: osmo-stp_10.42.42.5(pid=27158) [trial-2397↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27158)] + rm -rf trial-2397/inst + cd trial-2397 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-14 00:40:11 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397-run.tgz run.2022-12-14_00-40-22 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2397-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17684.tgz osmo-bts-oc2g.build-5540.tgz osmo-bts-sysmo.build-8044.tgz osmo-bts.build-7513.tgz osmo-ggsn.build-6693.tgz osmo-hlr.build-8717.tgz osmo-hnbgw.build-2991.tgz osmo-mgw.build-8962.tgz osmo-msc.build-29312.tgz osmo-nitb.build-12993.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30098.tgz osmo-stp.build-9258.tgz osmo-trx.build-4685.tgz osmocom-bb.build-4713.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE